you are viewing a single comment's thread
view the rest of the comments
[+] 4 points 4 months ago (1 child)
  • [–] 2 points 4 months ago*

    I use LMStudio, because it has quality of life improvements like nice GUI and huggingface search engine. Also they have Vulkan backend that at least on 7900XTX is ~10% faster than rocm (on LLama 3 8b Q4_0 it gets 115Tokens/s vs 105 on rocm)

  • source
  • parent