you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 4 months ago

Yes, llama-swap and I use it for home assistant text-gen notifications, basic coding tasks, etc

If anyone here self-hosts definitely check out llama-swap as it has some nifty features for hotswapping LLMs, image generation models and voice models.

  • source