Everybody has a theory about why Nvidia dropped $20B on Groq - they're mostly wrong
(www.theregister.com)
The use of SRAM as an alternative to HBM/DRAM is news for me.
You can get around this by building a bigger chip – each of Cerebras' WSE-3 wafers features more than 40 GB of SRAM on board, but these chips are the size of a dinner plate and consume 23 kilowatts. Anyway, Groq hasn't gone this route.
That is insane electricity usage for 40 GB of memory.