We are constantly fed a version of AI that looks, sounds and acts suspiciously like us. It speaks in polished sentences, mimics emotions, expresses curiosity, claims to feel compassion, even dabbles in what it calls creativity.
But what we call AI today is nothing more than a statistical machine: a digital parrot regurgitating patterns mined from oceans of human data (the situation hasn’t changed much since it was discussed here five years ago). When it writes an answer to a question, it literally just guesses which letter and word will come next in a sequence – based on the data it’s been trained on.
This means AI has no understanding. No consciousness. No knowledge in any real, human sense. Just pure probability-driven, engineered brilliance — nothing more, and nothing less.
So why is a real “thinking” AI likely impossible? Because it’s bodiless. It has no senses, no flesh, no nerves, no pain, no pleasure. It doesn’t hunger, desire or fear. And because there is no cognition — not a shred — there’s a fundamental gap between the data it consumes (data born out of human feelings and experience) and what it can do with them.
Philosopher David Chalmers calls the mysterious mechanism underlying the relationship between our physical body and consciousness the “hard problem of consciousness”. Eminent scientists have recently hypothesised that consciousness actually emerges from the integration of internal, mental states with sensory representations (such as changes in heart rate, sweating and much more).
Given the paramount importance of the human senses and emotion for consciousness to “happen”, there is a profound and probably irreconcilable disconnect between general AI, the machine, and consciousness, a human phenomenon.
All the evidence suggests that our own minds are also nothing more than probability engines. The reason we consider humans to be intelligent is because our brains learn to model the events in the physical world that are fed into our brains by the nervous system. The whole purpose of a brain is to try and keep the body in a state of homeostasis. That's the basis for our volition. The brain gets data about about the state of the organism, and interprets it as hunger, pain, fear, and so on. Then it uses its internal world model to figure out actions that will put the body into a more desirable state. From this perspective, embodiment would indeed be a necessary component of human style intelligence.
While LLMs on their own are unlikely to provide a sufficient basis for a reasoning system, its not strictly impossible that a model trained on sensory data from a robot body it inhabits wouldn't be able to build a representation of the world and its body that could be used as the basis for decision making and volition.