72
British fintech Revolut slashes AI coding costs 10x by cutting out Claude and going self-hosted (www.theregister.com)
submitted 5 days ago by to c/technology@lemmy.world
5 comments fedilink hide all child comments
 
you are viewing a single comment's thread
view the rest of the comments
[–] 20 points 5 days ago (3 children)

This seems like the way it's going to go. For large companies there is no doubt that LLMs can be helpful. But running your own hardware has been proven over and over to be less costly in the long term. So I can't imagine that subscription models like Claude and ChatGPT will be the final way it works.

  • permalink
  • fedilink
  • source
  • hideshow 3 child comments
    •
  • [–] 4 points 5 days ago

    Yeah it really only works for a company of that size when you can tip the scale into buying or renting enough to run the compute, but it makes sense. And I’m sure that Nvidia and others are probably sitting on a goldmine of compute optimization they’re not releasing because they want to milk the cow for as long as they can, or keep the compute savings to themselves

  • permalink
  • fedilink
  • source
  • parent