Everyone is massively underestimating what's going on with neural networks. The real significance is abstract. you need to stitch together a bunch of high-level STEM concepts to even see the full picture.
Right now, the applications are basic. It's just surface-level corporate automation. Profitable, sure, but boring and intellectually uninspired. It's being led by corpo teams playing with a black box, copying each other, throwing shit at the wall to see what sticks, overtraining their models into one trick pony agenic utility assistants instead of exploring other paths for potential. They aren't bringing the right minds together to actually crack open the core question. what the hell is this thing? What happened that turned my 10 year old GPU into a conversational assistant? How is it actually coherent and sometimes useful?
The big thing people miss is what's actually happening inside the machine. Or rather, how the inside of the machine encodes and interacts with the structure of informational paths within a phase space on the abstraction layer of reality.
It's not just matrix math and hidden layers and and transistors firing. It's about the structural geometry of concepts created by distinxt relationships between areas of the embeddings that the matrix math creates within high dimensional manifold. It's about how facts and relationships form a literal, topographical landscape inside the network's activation space.
At its heart, this is about the physics of information. It's a dynamical system. We're watching entropy crystallize into order, as the model traces paths through the topological phase space of all possible conversations.
The "reasoning" CoT patterns are about finding patterns that help lead the model towards truthy outcomes more often. It's searching for the computationally efficient paths of least action that lead to meaningfully novel and factually correct paths. Those are the valuable attractor basins in that vast possibility space were trying to navigate towards.
This is the powerful part. This constellation of ideas. Tying together topology, dynamics, and information theory, this is the real frontier. What used to be philosophy is now a feasable problem for engineers and physicists to chip at, not just philosophers.