268
If open weight models are the future, U.S. AI companies are going to have a hard time (www.fastcompany.com)
submitted 3 months ago by to c/technology@lemmy.world
86 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 3 months ago (3 children)

Or... honestly, just pay $40 for basically unlimited usage for a year from an API, then roll your own frontend.

Can you clarify, what you mean by this? Rent a VPS? Or is there a legitimately good place that'll offer "unlimited" llm api access for $40 / year (and would you have any sort of privacy with this)?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 2 points 3 months ago (2 children)

    I was thinking of Xiaomi's Lite coding plan:

    https://platform.xiaomimimo.com/token-plan

    My mistake, it's $60. But that's still dirt cheap.

    You can read their terms of service; coding APIs are generally less invasive than something like the ChatGPT app, but don't bet on any privacy either.

    For my personal setup, I actually run most queries locally, via MiMo 2.5, but send "bulk" privacy-insensetive prompts to the same model on the API, since its so much faster. I kinda use them in parallel.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 3 months ago (1 child)

    Thanks for sharing the link. I'll take a peek at them and their ToS.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 3 months ago*

    I also forgot to emphasize this, but Xiaomi’s plan, in my opinion, is undiscovered fruit.

    GLM had a similar coding plan, but once it got in the news and popular, it got WAY more expensive and limited. I’m grandfathered into 6 more months of a GLM plan you literally cannot buy now.

    And I think Xiaomi is in the same situation GLM was 6+ months ago. It’s a fantastic model series, but unlike Kimi/GLM no one knows about it yet, which is how it’s still $60 for a year.

  • permalink
  • fedilink
  • source
  • parent