you are viewing a single comment's thread
view the rest of the comments
[–] 14 points 2 weeks ago* (last edited 2 weeks ago) (1 child)

I’d be more interested in efficiency under load.

There is evidence that some training runs at bigger companies are hilariously inefficient, or even that they run busywork to meet contract quotas. And that’s not to speak of the questionable efficiency of US “frontier models.”

And I’ve seen some staggering inefficiency even just deploying stuff, like “running Ollama on an H100 box” levels of ignorance. It boggles my mind. The heck are they even paying their employees for?

  • source
  • hideshow 1 child comment