all 10 comments

sorted by: hot top controversial new old
[–] 5 points 5 months ago (3 children)

Why not use lamma.cpp and opencode?

Genuinely asking, what is the advantage of ollama, a nice ui for loading models?

  • source
  • hideshow 3 child comments
  • [–] 2 points 5 months ago (2 children)

    Until now, ollama model router implementation is still better. There is still no model queue system in llama-server.

    llama-server is also released around last year only.

    Maybe after https://github.com/ggml-org/llama.cpp/issues/21678#issuecomment-4592982609 then there is not much reason to use ollama.

    Anyway i stopped using ollama and just deal with the issue now. Because most huggingface models work better with llama.cpp.

    But i dont understand why everyone just keep bashing ollama. Does no one run multiple models?

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 5 months ago

    But i dont understand why everyone just keep bashing ollama. Does no one run multiple models?

    Because for the longest time they were just a wrapper around llama.cpp and not until pushed they acknowledged the devs behind llama.cpp. They also took a lot of the spot and funding for what actually was llama.cpp features.

  • source
  • parent
  • [–] 3 points 5 months ago* (last edited 5 months ago) (4 children)

    I am embarrassed to say that I was not aware that ollama was NOT* open source and running on an MIT license I will definitely check this out later. Hopefully more open source des take interest in supporting an open source AI ecosystem.

  • source
  • hideshow 4 child comments
  • [–] 1 point 5 months ago (3 children)

    Ollama is not open source? It seems to be MIT licensed: https://github.com/ollama/ollama/blob/main/LICENSE. Am I overlooking something?

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 5 months ago (2 children)

    My mistake it I swaped MIT license with AGPL. I was under the impression that an MIT license was less permissive than an AGPL one.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 5 months ago (1 child)

    Just to know if you are not aware, you are putting a penny in a hot debate in the free software community on which license is the more open, is the best.

    The MIT is clearly the most permissive because it allows you, among other things, to just run with the software and close it, adding your modification and sell it without sharing source.

    Afero GPL prevents you from selling the software or even selling services that run the software without sharing/publishing it.

    In a MIT->AGPL swap you will find people who consider it a step into being closer to free software ideals and people who consider it getting further away from it.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 5 months ago

    I prefer llmstudio tbh

  • source