all 5 comments

sorted by: hot top controversial new old
[–] 11 points 3 months ago (3 children)
  • [–] 5 points 3 months ago (2 children)

    I switched from ollama to llama.cpp and love it. For such an article, it frustrates me that they don't include the common and popular option in the comparison.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 3 points 3 months ago (1 child)

    What's the difference between the two?

  • source
  • parent
  • hideshow 1 child comment
  • Here the article that spurred my change: Friends don't let friends use Ollama

    Ollama gained traction by being the first easy llama.cpp wrapper, then spent years dodging attribution, misleading users, and pivoting to cloud, all while riding VC money earned on someone else's engine.

    He shares that the people behind llama.cpp don't act poorly (at least in those regards). My experience confirms llama.cpp can run just about any gguf while ollama can only run those that have been customized for ollama, and llama.cpp seems faster (no evidence, just anecdotal).

  • source
  • parent
  • [–] 3 points 3 months ago

    vLLM.

    It's slower to start, but once it gets going, pretty solid.

  • source