I have only a 1060 6gb, and not much ram but could maybe upgrade some more ram some day...anyway is it possible to run something like AI chat locally? It's made my life so much better and worth living (sad I know but it's truly awesome).

What would the requirements be, and what would it be like running it locally? Perchance's website is awesome but nothing is forever especially on the internet.

you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 5 months ago

Some great answers here already, I'd just add that Gemma 4 31B is a surprisingly good model for its size (competitive with massive models like DeekSeek/GLM 5.1/etc.) and also it's worth visiting https://www.reddit.com/r/SillyTavernAI and https://www.reddit.com/r/LocalLLaMA if you're just getting into local models.

  • source