how it makes sense to build so much compute capacity so quickly. There seem to be predictions saying that we’ll need vastly more DCs and electricity running compute in the future
Every new datacenter coming online was decided 2 years prior at least. 2 years ago, skynet requirements seemed to be to scale models 10x or 100x their size. Datacenters huge enough to train that skynet goal will come online in 2028. SpaceX, perhaps other 2 labs, have centers big enough for 10T parameter models (about 5x the size of largest published frontier sizes). These are inherently 5x more expensive and 5x slower than frontier for inference, and meant to be trained with 5x the data at 5x the cost = 25x total training budget.
This is a speculative value proposition that I doubt to be a smart jump in model size. But 3x larger training capacity datacenters are scheduled for 2028, which is skynet dependency rather than following the economic efficiency (smaller/smarter) trend that is dominating currently instead.
Path that was laid out years ago is that skynet will buy every token, and so compute will always be scarce. US must pick AI as the last battle on China, because there are none left, and entire financial industry must go all in on skynet future. Financial industry did, but they are tapped out. Political environment is not to give government a $1T token budget for skynet at this time. AI revenue growth is plateuing, and GPU pricing is tanked.
The .com bubble was less desperate, or dependent on a government corruption backstop for skynet. But as everyone who participated in the gold rush, they didn't fully evaluate the consequences of competition for shovels.