LLMs and Humans are Cognitive Cousins – Sean Carroll podcast w/Dr. Chandra Sripada
(preposterousuniverse.com)
They can’t simply go back to correct their beliefs
Backtracking is a common and integral part of the reasoning learned by what used to be called Large Reasoning Models but today is part of almost any modern model design, much like Mixture-of-Experts