you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 7 months ago

Probably. It just not as fast as 9070 XT. I'm using 9070 XT myself and limitation for running LLMs is memory, not speed. If model fit in memory it will runs fast enough to be practical.

  • source
  • parent