Has anyone tried in organization to use self hosted llm models for agentic programming?

Im curious if it makes any sense. My organization spends fortune on tokens from us companies. I want to recommend something…

you are viewing a single comment's thread
view the rest of the comments
[–] 19 points 5 months ago (1 child)

it MIGHT pay for itself in.. A while

considering all the cloud ones are currently running at a loss, and hardware prices are way inflated: I doubt that.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 6 points 5 months ago

    If you think long term as a company that uses AI that's the way to go anyway, your own AI server.

    But alas, nobody cares about the long term, because the cunts at the top of the AI stack always make sure to make things so volatile that the little guy can never survive past the short term.

    The solution? Oh just pay the big corporations to be dependent on them and not build your own thing. Surely that will help.

    You have to realize, that by your own words, AI subscription prices will skyrocket eventually. So the cost analysis of your own AI server has to take that into account too, not just the current prices and current upfront cost.

  • source
  • parent