I have avoided AI (LLMS) because it didn't seem nearly useful enough to warrant supporting these tech assholes. Is there anyway to use it locally on a normal device (16 Gb ram, 8 year old Geforce graphics, etc?). Can I just slow it down and get it to work locally?

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 6 days ago

Yeah, I'm running a mix of three 8B LLMs on an old MBP from 2018. Its not perfect, and it's slow, but when you know how to use it, it works well enough to keep it going.

  • source