you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 1 year ago (1 child)

Selfhost your LLM's Qwen3:14b is fast, open source and answers code questions with very good accuracy.

You only need ollama and a podman container (for openwebUI)

  • source
  • hideshow 1 child comment
  • [–] 3 points 1 year ago

    Frankly, I don't think you seriously tested anything that you've mentioned here.

    Nobody's using Qwen because it doesn't do tool calls. Nobody really uses ollama for useful workloads because they don't own the hardware to make it good enough.

    That's not to say that I don't want self-hosted models to be good. I absolutely do. But let's be realistic here.

  • source
  • parent