Everything runs well if one is patient enough 😂

But yeah, with a smaller context and carefully offloading some of the layers to the CPU, it'll run just not very fast. And definitely using Q4 quants.

No you don't need a data center, this can run on any current gaming PC with a GPU that has 16GB+ VRAM.

Although to get good token generation speed and full context you need at least 24GB VRAM.

Appears they removed the branch and changesets

I only have 8gb vram and can run 35b-a3b perfectly (30+ tps), have you tried 35b?

Wow, got about 9 repos of mine there and a few from my startup's, only public ones are scraped so I say fair enough. Happy to have switched to running my own git infra a year ago

I hope their decision to opensource Qwen3.8-Max means this version is going to be another open-weights frontier contender 👍