In the release page: "The other model(s) in Qwen3.8-series would be released later", we know that Qwen3.8-27B is dropping next, but that statement implies there might be other models beyond the 27B!

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 2 months ago

You can also use something like llama-swap to seamlessly swap between them.

FYI: llama-server has built-in model swapping now so you don't need a second piece of software (at least for the simple cases). I pass --model-presets and a path to an INI file with the per-model parameters when I run the server.

  • source
  • parent