That was true a couple of years ago, but inference is the primary driver of data center build out now and expected to only increase over coming years. It's true that Inference is cheap per token, and a lot of inference will move to the edge, but there will be even more demand for centralized compute to take the place of that with more complex and demanding models which can't run on edge devices.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
replies: