you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 1 year ago (8 children)

Seems pretty decent, but I wonder how it compares to an AI optimized desktop build with the same budget of 2000$.

  • source
  • hideshow 8 child comments
  • [–] [S] 2 points 1 year ago* (7 children)

    It will probably kick the ass of that desktop. $2000 won't get you far with a conventional build.

  • source
  • parent
  • hideshow 7 child comments
  • [–] 1 point 1 year ago* (5 children)

    Well, thats what I said "AI optimized".

    Even my 5 year old 900$ rig can output like 4 tps.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 1 point 1 year ago (3 children)

    With what model? GPT oss or something else?

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 1 year ago* (last edited 1 year ago) (2 children)

    LLama 3 8B Instruct: 25tps

    DeepSeek R1 distill qwen 14b: 3.2tps

    To be fair: Motherboard, cpu and ram I bought 6 years ago with an nvidia 1660. Then I bought the Radeon RX 6600 XT on release in 2021, so 4 years ago. But it's a generic gaming rig.

    I would be surprised if 2000$ worth of modern hardware, picked for this specific task would be worse than that mini PC.

  • source
  • parent
  • hideshow 2 child comments