I have avoided AI (LLMS) because it didn't seem nearly useful enough to warrant supporting these tech assholes. Is there anyway to use it locally on a normal device (16 Gb ram, 8 year old Geforce graphics, etc?). Can I just slow it down and get it to work locally?

you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 6 days ago (3 children)

Download Ollama. Download one of the smaller Qwen models. Have at it.

Try qwen3.5:9b (a 7.6Gb model) to start.

  • source
  • hideshow 3 child comments
  • [–] 0 points 5 days ago (2 children)

    Friends don't let friends use Ollama.

  • source
  • parent
  • hideshow 2 child comments