Trying to etch models into a chip is a dead end until we reach “peak” quality.

However, unless they include some kind of LoRA (low-rank adaptation) adapter onto the silicon, it severely limits the utility of whatever model or architecture they choose. Being able to modify the weights is way more useful.

Honestly, diffusion decoders are probably where we’ll end up some day. Not end there, but that’s probably the next logical step in the throughput chain.

General purpose compute is infinitely more valuable during times of great software improvements than highly specialized compute.

Things like Tensor Processing Units (TPUs) still aren’t ubiquitous yet, even though they’ve been around for 10+ years. They’re Too specialized to allow for reasonable flexibility on testing.