Make it make sense (piefedimages.s3.eu-central-003.backblazeb2.com)
submitted 10 months ago by to c/microblogmemes@lemmy.world
 
Just so I'm clear on this, computer memory has tripled in price because a bunch of it that hasn't been produced yet has been ordered to populate GPUs that aren't installed in data centers that aren't built yet in order to service a demand that doesn't exist to make profits that don't happen.
you are viewing a single comment's thread
view the rest of the comments
[–] 19 points 10 months ago (1 child)

Microsoft and Nvidia have been trying for years to offload computing power to their own systems, while your computer becomes little more than a remote access terminal into this power when these companies allow you access to it.

See; Nvidia Now, Xbox Cloud Gaming, and pretty much every popular LLM (there are self-hosted options, but that's not the major market rn, or the direction it's headed)

There's ofc struggles there, that they have had a hard time over comming. Particularly with something like gaming, you need a low latency, high speed internet connection; but that's not necessary for all applications, and has been improving (slowly).

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 10 months ago

    Actually open weights models have gotten better and better to the point they actually can compete meaningfully with ChatGPT and Claude Sonnet. Nvidia are actually one of the ones spearheading this with Nemotron. The issue is more that most of the really competent models need lots of VRAM to run. Small models lag quite far behind. Although with Nemotron Nano they are getting better.

  • source
  • parent