Managers
you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 5 months ago (5 children)

huh, i thought that ryzen ai thing would perform better than that. my 7900xtx regularly gets 30+tps with qwen, up to hundreds with more compressed models.

  • source
  • parent
  • hideshow 5 child comments
  • [+] 2 points 5 months ago* (4 children)
  • [–] 2 points 5 months ago (3 children)

    that's fair, i'm at like 7x the power. the gpu alone easily pulls 350-400W and the rest of the system isn't exactly running lean either.

    ...man now i really want more vram.

  • source
  • parent
  • hideshow 3 child comments
  • [+] 1 point 5 months ago* (last edited 5 months ago) (2 children)