1 comment

sorted by: hot top controversial new old
[–] 4 points 4 weeks ago

correct. the future has always been local, that you control. nvidia has already started selling consumer ai hardware.

  • source
  • 14 comments in c/technology@lemmy.world view that post
    [–] 21 points 4 weeks ago (1 child)

    I'm also impressed with GLM-5.3-Flash. This is similar to Claude Opus 4.8. It's much smaller and cheaper than GLM-5.3, and still incredibly capable. It's also actually feasible for an individual person to get hardware to run it, like if you can one day get your hands on a Mac Studio with 512GB of RAM.

    512 GB of RAM?!

    My brother in christ I don't even have 12 GB of ram! I don't even have 512GB of SSD storage!

  • source
  • hideshow 1 child comment
  • [–] 14 points 4 weeks ago

    I say no to all of it.

  • source
  • [–] 6 points 4 weeks ago (2 children)

    It's also actually feasible for an individual person to get hardware to run it, like if you can one day get your hands on a Mac Studio with 512GB of RAM.

    From the article.

    Apple announced the M5 Ultra Mac Studio on August 26, 2026, with pre-orders open today and shipping on September 22. The headline number for local AI is 512GB of unified memory at 1.2 TB/s of memory bandwidth, starting at $5,499.

    https://modelfit.io/blog/mac-studio-m5-ultra-512gb-local-llm/

    Can't find any for sale, because it seems completely unavailable at the moment. That aside, I wouldn't call a price point of $5500 USD 'feasible'.

  • source
  • hideshow 2 child comments
  • [–] 0 points 3 weeks ago

    Ehhh if it's a hobby you're really into it's not a crazy amount, I spent way more than that on motorcycles just for shits and giggles, 5k of photography equipment is a pretty small and sad pile, same with hi-fi, fishing, watches, bicycles etc.

  • source
  • parent
  • [–] 6 points 4 weeks ago (6 children)
  • [–] 1 point 3 weeks ago (2 children)

    DeepSeek r1 or small local models

  • source
  • parent
  • hideshow 2 child comments
  • [–] 5 points 3 weeks ago

    I've preferred Chinese alternatives since they became available. Fuck clammy Sam Altman and Wario, and I don't really give a shit otf the Chinese know I can't write my own yaml

    The tech is legitimately cool, but American AI CEOs are unbearable cunts that only make hype

  • source