โฒ 561 โผ Angry devs vow to flee GitHub Copilot as metered billing takes hold (www.theregister.com) submitted 5 months ago by throws_lemy@reddthat.com to c/technology@lemmy.world 120 comments fedilink hide all child comments ๐ 1
[+] favoredponcho@lemmy.zip 5 points 5 months ago* (2 children) [deleted] permalink fedilink source parent hideshow 2 child comments replies: [โ] boonhet@sopuli.xyz 9 points 5 months ago That's the biggest baddest model out there. There are models that get you 90% of the way there with a significantly smaller parameter count and thanks to MoE offloading you don't need the entire model active at once. A 5090 and a beefy CPU and tons of RAM won't be cheap or even affordable to most, but you could run very big models and have a beefy PC for other activities. But even a 16 GB card could do plenty. permalink fedilink source parent [โ] kamen@lemmy.world 4 points 5 months ago Yeah, I'm aware. I have realistic expectations and I'm looking into running something simpler and less demanding. permalink fedilink source parent
[โ] boonhet@sopuli.xyz 9 points 5 months ago That's the biggest baddest model out there. There are models that get you 90% of the way there with a significantly smaller parameter count and thanks to MoE offloading you don't need the entire model active at once. A 5090 and a beefy CPU and tons of RAM won't be cheap or even affordable to most, but you could run very big models and have a beefy PC for other activities. But even a 16 GB card could do plenty. permalink fedilink source parent
[โ] kamen@lemmy.world 4 points 5 months ago Yeah, I'm aware. I have realistic expectations and I'm looking into running something simpler and less demanding. permalink fedilink source parent