We quickly being put back into a pre 80's PC as a luxury era.

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 3 months ago (2 children)

IMO those datacenter plans are going to go poof in the face of open weight model efficiency gains. There will be lots of cheap ram.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 3 months ago

    Those efficient open weight models still need 500k of hardware to run the good ones for a few concurrent users (single digit amount). They still require a ton of resources for training.

  • source
  • parent