you are viewing a single comment's thread
view the rest of the comments
[–] 7 points 15 hours ago (1 child)

Amazon was building a platform, that now they use as a rentier. Bad for society, good for Amazon.

But LLM models don't have that. You can swap one out for another with little effort - hell, I do it daily. And with that, it means that you're a commodity . . . which also means you can't ever get those initial losses back if your competitor (like Chinese models) doesn't have them.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 14 hours ago

    Have you seen openrouter.ai? They are more or less based around that idea, I think. Routing to whatever is best fit - most likely on price, I'd think (?) and/or currently up.

    I have not set it up myself, but I think there is a way to have opencode or the like prefer local models for certain things, then escalate to something remote (presumably paid) if needed.

    Also, opencode.ai gives you so many free tokens per day on some of their models.

  • source
  • parent