The Role of AI and Automation: How will AI, machine learning, and autonomous systems impact engineering in the next 5-10 years?

I'm currently reading "Thinking Fast and Slow" by Daniel Kahneman.  As humans, we have two modes of thought: System 1 which is fast, based on instinct and experience, and often prone to error; and System 2, which is slower, more methodical and based on calculation.  As humans, we default to System 1 when we can because it takes less effort, although it is prone to systematic errors and bias.  My impression is that LLMs like ChatGPT have the same flaw, they default to their System 1.  When I asked ChatGPT about one of KCC's Quiz questions, it came up with an answer that was wrong.  When I pointed out the error, it switched its answer.  No apology.  No mea culpa.  Not even a, "your right!"  Just like a politician, LLMs seem to prioritize giving an answer, even if it is incorrect, over admitting they don't know or they need more information before they can give an answer.  As humans, we're experts in using System 1 and what we really want from AI is for it to do the hard calculation required for System 2.  However, currently, it seems AI is as lazy and biased as we are...

MTF_Walker I read and reread this; it’s so true. I tested it myself, and yes, I do want AI to handle the hard work, not the simple or the regurgitation of what I can already do in default thinking mode. Right? I can see the danger in relying on AI 100%, hence the disclaimer that "ChatGPT can make mistakes. Check important info"

MTF_Walker I have had the same experience with ChatGPT when creating a quiz and receiving the wrong answer.  I learned not to believe the answer blindly but to research because you are right, there are no apologies..LOL