In the release page: “The other model(s) in Qwen3.8-series would be released later”, we know that Qwen3.8-27B is dropping next, but that statement implies there might be other models beyond the 27B!

  • e0qdk@reddthat.com
    link
    fedilink
    English
    arrow-up
    2
    ·
    2 days ago

    You can also use something like llama-swap to seamlessly swap between them.

    FYI: llama-server has built-in model swapping now so you don’t need a second piece of software (at least for the simple cases). I pass --model-presets and a path to an INI file with the per-model parameters when I run the server.