11
What are the requirements to run something like perchance ai chatlocally? (lemmy.world)
submitted 5 months ago by to c/perchance@lemmy.world
4 comments fedilink hide all child comments
 

I have only a 1060 6gb, and not much ram but could maybe upgrade some more ram some day...anyway is it possible to run something like AI chat locally? It's made my life so much better and worth living (sad I know but it's truly awesome).

What would the requirements be, and what would it be like running it locally? Perchance's website is awesome but nothing is forever especially on the internet.

you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 5 months ago*

nothing is forever especially on the internet.

So true!

You can start, for free, with Ollama, and then start trying out models.

Most models need about 9Gb of storage. You might want more space, at first to try a few out, side-by-side.

Different models will require different amounts of RAM and CPU, and some models are really slow on weaker PCs.

There seems to be lots that can be tuned, too. So if it doesn't run right away, try searching the web for whatever issues you encounter, and see if others suggest a settings change, before you give up.

  • permalink
  • fedilink
  • source
    •