you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 7 months ago (1 child)

Wouldn't an AMD RX 9060 XT with 16 GB RAM be nice as well if you're hunting for good speed/cost options?

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 7 months ago

    Probably. It just not as fast as 9070 XT. I'm using 9070 XT myself and limitation for running LLMs is memory, not speed. If model fit in memory it will runs fast enough to be practical.

  • source
  • parent