I have avoided AI (LLMS) because it didn't seem nearly useful enough to warrant supporting these tech assholes. Is there anyway to use it locally on a normal device (16 Gb ram, 8 year old Geforce graphics, etc?). Can I just slow it down and get it to work locally?

you are viewing a single comment's thread
view the rest of the comments
[–] 6 points 6 days ago (1 child)

For those who wish to avoid big tech, and don't mind potentially being on a data center: openrouter lets you use w/e model you wish (even free), paying per token, from whatever provider you wish (in particular, smaller companies, folks self hosting, etc.)

Some datacenters are built in terrible places, but not all.

  • source
  • hideshow 1 child comment