LLMs and Humans are Cognitive Cousins – Sean Carroll podcast w/Dr. Chandra Sripada
(preposterousuniverse.com)
You can replace all the 'reasoning' steps from an LLMs output with "please wait" and it will still supply the same final answer. We think but LLMs just throw up connected bits of their training. Which was stolen from human reasoning in the first place. They are an illusion of thought at best and a malfunctioning search engine most of the time.