OpenAI admits AI hallucinations are mathematically inevitable, not just engineering flaws
(www.computerworld.com)
To the network, matrix operations are simultaneous. Not that I believe parallelism is necessary. Embodiment is more plausible, but we just don't know.
We do know LLMs kinda suck. They're a bad first attempt. Diffusion emerged at the same time, and now generates plausible video faster than a camera. Those models are witchcraft and the witchcraft keeps getting stronger. LLMs hit a plateau because this is what they do. An ungodly amount of money has been spend chasing marginal improvements at ballooning scale. Higher abstraction will likely emerge as companies shrink models down and pursue maximum training epochs... but they'll always be more chatbot than person.