Has anyone tried in organization to use self hosted llm models for agentic programming?

Im curious if it makes any sense. My organization spends fortune on tokens from us companies. I want to recommend something…

you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 5 months ago* (last edited 5 months ago)

GLM is pretty good in mg experience, the company I currently freelance at runs it locally (in house server room) for compliance reasons. But it needs very beefy hardware.

  • source