you are viewing a single comment's thread
view the rest of the comments
[+] [S] 14 points 9 months ago* (last edited 6 months ago) (1 child)
  • [–] 1 point 9 months ago

    I never knew LLMs can run on such low-spec machines now! That's amazing. You said elsewhere you're using Qwen3-4B (abliterated), and I found a page saying that there are Qwen3 models that will run on "Virtually any modern PC or Mac; integrated graphics are sufficient. Mobile phones"

    Is there still a big advantage to using Nvidia GPUs? Is your card Nvidia?

    My home machine that I've installed ollama on (and which I can't access in the immediate future) has an AMD card, but I'm now toying with putting it on my laptop, which is very midrange and has Intel Arc graphics (which performs a whole lot better than I was expecting in games)

  • source
  • parent