I'm new to local llms, i'm running Debian on this machine. Where should I start and what model(s) could I get testing on it?

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 5 days ago* (1 child)

You could try KoboldCpp with the All-in-one Starter Pack V2. Or go through their newbie-templates.

  • source
  • hideshow 1 child comment