282
Firm that lets you rent out your idle Mac for AI inference workloads warns of plummeting token costs — Darkbloom network sees earnings drop to $1.23 a day as Anthropic tokens fall 77%. (www.tomshardware.com)
submitted 6 days ago by to c/technology@lemmy.world
81 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 5 days ago (3 children)

Which hardware is for running local models that is cheap? I was not looking at GPU market for around two years, because I thought everything got expensive through the roof.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 6 points 5 days ago (2 children)

    Nothing consumer grade - I'm talking about nVidia DGX.

    $6k for the cheapest might seem expensive to a lot of people, but for an engineer with stupid amounts of data and a 1.2kW power draw, it's insanely affordable from corporate perspectives.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 5 days ago (1 child)

    Depending on what you're looking at, a Mac Studio might be the most bang for your buck. They have much higher memory bandwidth than the DGX Spark

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 5 days ago

    I'd have to look way more into it, but from what we were looking at, DGX spark is made with the intent of scaling from local development to datacenter execution. From memory the Mac Studio was an extremely beefy workstation.

    Both serve the purpose better than whatever my laptop's RTX ADA 2000 can produce lol

  • permalink
  • fedilink
  • source
  • parent