Has anyone tried in organization to use self hosted llm models for agentic programming?

Im curious if it makes any sense. My organization spends fortune on tokens from US companies. I want to recommend something… I think that will be cheaper to use it on own machines instead…

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 5 months ago

I had been using it for almost a year but it's really dumb compared to the big three US llms. I had to unsubscribe since "it's not US" alone didn't justify the fees.

  • source
  • parent