you are viewing a single comment's thread
view the rest of the comments
[–] 16 points 2 weeks ago* (last edited 2 weeks ago)

Also, on open models: I can run Deepseek V4 Flash at 20 tokens/s on a single 3090 desktop, a Ryzen 7800, and 128GB RAM, with measurably low quantization loss. And 4.1 once the engine updates to support it.

That was eye-opening to me. Thats faster than some cheap APIs, and higher quality too. Once companies figure that out, what are they gonna do with all those idle datacenters?

  • source
  • parent