The gains in AI have been almost entirely in compute power and training, and those gains have run into powerful diminishing returns. At the core it's all still running the same Markov chains as the machine learning experiments from the dawn of computing; the math is over a hundred years old and basically unchanged.
For us to see another leap in progress we'll need to pioneer new calculations and formulate different types of thought, then find a way to integrate that with large transformer networks.