[–] 2 points 2 weeks ago* (last edited 2 weeks ago)

I use llama-swap with a couple of different models, one 8B as a general chat bot, with offloading to several MoE-models for specific workloads. It's all run on an old dell xps with 64GB ram.

Mine is used for code reviews, general questions, coding assistance and for anything else I can think of.

  • source
  • [–] 3 points 1 month ago

    Just started reading Scion by James Islington. Haven't really gotten into it fully yet, but I find the writing style a bit flat and driven by every obvious punchline.

  • source
  • view more: next ›