▲ 1054 ▼ Anthropic logged net loss of over $80 billion in first half of 2026 (www.reuters.com) submitted 2 weeks ago by panos@catodon.rocks to c/technology@lemmy.world 311 comments fedilink hide all child comments
[–] Seralth@piefed.seralth.com 5 points 2 weeks ago (4 children) At 3 tokens a second and calling it useble I would guess? I see people claiming that shit all the time and it's baffling. permalink fedilink source parent hideshow 4 child comments replies: [–] chrisashtear@lemmy.zip 2 points 2 weeks ago (2 children) They said 50- i looked up strata, and it uses smaller quantizations/optimizations of that model depending on your system. I have 48g vram and 192g system ram and get ~15t/s on qwen 3.8 flash next at Q4. Off the top of my head. I think Q6 is 12. permalink fedilink source parent hideshow 2 child comments replies: [–] Seralth@piefed.seralth.com 1 point 2 weeks ago I started looking into it finally after making that comment and came across strata come back here and everyone is saying strata. I guess im trying strata? permalink fedilink source parent [–] jaschen306@sh.itjust.works 1 point 2 weeks ago https://sh.itjust.works/comment/28041846 Try it out and let me know if you can get higher. permalink fedilink source parent [–] jaschen306@sh.itjust.works 1 point 2 weeks ago https://sh.itjust.works/comment/28041846 I didn't believed it until I started using it. permalink fedilink source parent
[–] chrisashtear@lemmy.zip 2 points 2 weeks ago (2 children) They said 50- i looked up strata, and it uses smaller quantizations/optimizations of that model depending on your system. I have 48g vram and 192g system ram and get ~15t/s on qwen 3.8 flash next at Q4. Off the top of my head. I think Q6 is 12. permalink fedilink source parent hideshow 2 child comments replies: [–] Seralth@piefed.seralth.com 1 point 2 weeks ago I started looking into it finally after making that comment and came across strata come back here and everyone is saying strata. I guess im trying strata? permalink fedilink source parent [–] jaschen306@sh.itjust.works 1 point 2 weeks ago https://sh.itjust.works/comment/28041846 Try it out and let me know if you can get higher. permalink fedilink source parent
[–] Seralth@piefed.seralth.com 1 point 2 weeks ago I started looking into it finally after making that comment and came across strata come back here and everyone is saying strata. I guess im trying strata? permalink fedilink source parent
[–] jaschen306@sh.itjust.works 1 point 2 weeks ago https://sh.itjust.works/comment/28041846 Try it out and let me know if you can get higher. permalink fedilink source parent
[–] jaschen306@sh.itjust.works 1 point 2 weeks ago https://sh.itjust.works/comment/28041846 I didn't believed it until I started using it. permalink fedilink source parent