561
Angry devs vow to flee GitHub Copilot as metered billing takes hold (www.theregister.com)
submitted 5 months ago by to c/technology@lemmy.world
120 comments fedilink hide all child comments
πŸ‘ 1
you are viewing a single comment's thread
view the rest of the comments
[–] 20 points 5 months ago (6 children)

Local AI it is then. Not that I'm using all that much now anyway...

  • permalink
  • fedilink
  • source
  • hideshow 6 child comments
    •
  • [–] 13 points 5 months ago* (last edited 5 months ago) (2 children)

    Where I work, Chinese models are banned due to legal concerns. Not just in production, on any company-owned machine. That basically eliminates all the decent open weight models. I’m imagining this type of policy will be more widespread. I suppose it’s because of the potential for legal woes if systems and people are dependent on these models and then federal or state laws impose harsh penalties with little time to react.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [+] 5 points 5 months ago* (2 children)
    [deleted]
  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 9 points 5 months ago

    That's the biggest baddest model out there. There are models that get you 90% of the way there with a significantly smaller parameter count and thanks to MoE offloading you don't need the entire model active at once.

    A 5090 and a beefy CPU and tons of RAM won't be cheap or even affordable to most, but you could run very big models and have a beefy PC for other activities. But even a 16 GB card could do plenty.

  • permalink
  • fedilink
  • source
  • parent