1054
Anthropic logged net loss of over $80 billion in first half of 2026 (www.reuters.com)
submitted 2 weeks ago by to c/technology@lemmy.world
311 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 2 weeks ago (7 children)

How do you run qwen 3.8 flash next on 16gb vram, if you don't mind me asking ?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 7 child comments
    •
  • [–] 5 points 2 weeks ago (4 children)

    At 3 tokens a second and calling it useble I would guess?

    I see people claiming that shit all the time and it's baffling.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 2 points 2 weeks ago (2 children)

    They said 50- i looked up strata, and it uses smaller quantizations/optimizations of that model depending on your system.

    I have 48g vram and 192g system ram and get ~15t/s on qwen 3.8 flash next at Q4. Off the top of my head. I think Q6 is 12.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 2 weeks ago

    need 64gb of system ram. qwen next architecture uses smaller experts than others, and it can keep up with ram swap. I believe it uses a file on disk (ngram) to predict what experts will be needed.

  • permalink
  • fedilink
  • source
  • parent