I am looking at resintalling my OS (currently Mint) which I have been running for a few years.

Mint is great and I may end up going back; but was thinking of trying something new.

I want to be able to play with local models and agents; I have a pretty decent system.

  • AMD 3700X
  • 64 GB DDR4
  • AMD RX9070 16GB GPU
  • 2TB NVME SSD
  • A few TB of HDD's

What are some good options for easily running models and agents; I have been using ollama to run models; but I'm sure things have moved on since I begun playing with things a year ago.

Give me a few tips; I am going to have a bit of time on my hands over the next few months.

you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 5 days ago

Look at rolling releases. I've used Mint but at the time (maybe still today) some projects required the latest ROCm drivers, and Mint's repositories are just too slow to keep up with pace of AI. I decided to go with EndeavourOS since it's a fork of Arch so it's a rolling release, and you can keep up with the latest experimental AI hacks that are developed. The downside to a rolling release is that sometimes you update your computer and something stops working, like your sound drivers or Steam. But someone always finds a fix a few hours later. It doesn't happen every time. I generally update my system when I need to, so about every month or two. I use EndeavourOS as my daily driver actually, so it's not unstable at all. Anyway, look at rolling releases that have more than 1 maintainer. Look at their forum, see how helpful it is, etc.

  • source