you are viewing a single comment's thread
view the rest of the comments
[–] 41 points 1 year ago (11 children)

How does one install friends (i want to compile them first)

  • source
  • parent
  • hideshow 11 child comments
  • [–] [S] 52 points 1 year ago (3 children)
  • [–] 5 points 1 year ago* (5 children)

    ollama.

    I've got a local llm model running on my steam deck just to see if it could do it.

    It can!

    ... It is polite, but also somewhat limited... but at least it is honest about its limitations, I have not gotten it to hallucinate anything insane yet.

    Anyway yeah I think there are just docker images for ollama, you can install a friend (kind of) today!

  • source
  • parent
  • hideshow 5 child comments
  • [–] 4 points 1 year ago (4 children)

    Oh man, Silly tavern with kobold is way better. I've been using the Omega models and boy oh boy I've never had more friends! Or such well fleshed out ones either!

  • source
  • parent
  • hideshow 4 child comments
  • [–] 3 points 1 year ago (3 children)

    ... if you are saying that silly tavern is some kind of local llm thing, i will have to look into that, I've not heard of that haha!

  • source
  • parent
  • hideshow 3 child comments
  • [–] 3 points 1 year ago (2 children)

    Silly tavern is a local fronted, can be used with api models from the internet as well. Highly modular, similar to character ai, but fully local. Would suggest messing with the themes if you know how theming works, its a tab bit dated in design, still amazing though.

  • source
  • parent
  • hideshow 2 child comments