188
Memory Prices Indefinitely High: SK Hynix Says Shortage Continues Through 2030 - PC Perspective (pcper.com)
submitted 2 months ago by to c/technology@lemmy.world
40 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 91 points 2 months ago (6 children)

Bullshit. Chinese RAM is ramping up to world scale levels. LLMs are reaching massive diminishing returns points, and open weights local AI setups that are near frontier level, and which can be run on consumer level hardware are already here, and getting very hardware efficient. The AI bubble burst is very close. Memory makers are pushing FOMO buying.

  • permalink
  • fedilink
  • source
  • hideshow 6 child comments
    •
  • [–] 14 points 2 months ago (1 child)

    This. As with any technology, it will always improve. The American government helped the Chinese by barring the chips from them, meaning they had to program more efficient models.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 2 months ago

    We don't know if they're actually more efficient because ClosedAI and Anthropic won't tell us how (in)efficient their models are, whether they're running quants, etc. Kimi K3 is about 3 terabytes of VRAM unquantized so I wouldn't call the Chinese models super efficient either. The "efficient" models are the distillations and particularly quantized versions of some Chinese models. Nothing stopping ClosedAI and Anthropic from doing the same if they're willing to lose a bit in accuracy.

  • permalink
  • fedilink
  • source
  • parent