you are viewing a single comment's thread
view the rest of the comments
[–] 12 points 2 months ago (4 children)

I'm so glad the latest breakthroughs in AI are about doing more with less in the form of Quantization and Distillation efforts.

It's gonna make these AI focused companies like Meta realize how exposed and stupid they are for buying out more equipment then they had any plans to do with. And I hope that they fail hard without a government bailout.

  • source
  • hideshow 4 child comments
  • [–] 6 points 2 months ago (1 child)

    I’m no expert, but I’ll bet that there is plenty of work being done on the ultra-high level to maximize usage of their resources.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 2 months ago* (last edited 2 months ago)

    It's not surprise that the real efficiency gains came out of China.

    Most of AI is funded by NVIDIA explicitly and obviously as a way to goose their stock price. You think AI companies who depend on getting money from NVIDIA on the condition they buy a lot of NVIDIA GPUs are going to go out of their way to lower the cost of compute?

    Edit: Actually, I think it doesn't matter. AI is so divorced from reality, OpenAI can say they lowered the cost of compute by 95% and therefore they have to triple their orders of GPUs.

  • source
  • parent
  • [–] 2 points 2 months ago

    Oh come on, of course they'll be bailed out. They're US flagship IT companies and the c-suite is all billionaires. It doesn't matter they only produce utter shit now, they will be hailed out when they fail, the Cheeto will make sure of that

  • source
  • parent