you are viewing a single comment's thread
view the rest of the comments
[–] 8 points 5 months ago* (last edited 5 months ago) (1 child)

$15k would get you a used AMD server, a 5090 or a set of 3090s, and enough leftover cash for electricity to just run a 1T parameter LLM at home. Plus, it’s yours.

And that’s hilariously inefficient.

It’s completely nuts to me that people pay Anthropic per token, at that rate. I think 1 whole year for GLM’s coding plan was a flat $30, or something.

  • source
  • hideshow 1 child comment