you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 2 months ago (1 child)

Why not llama.cpp? Ollama is just a wrapper over it.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 2 months ago

    Mostly time. I didn't buy the machine to run someone else's models. I bought it to run my own models and the machine has a job to do. Tinkering with self hosting llms, I guess. I appreciate them as models. But my machine has a day job.

  • source
  • parent