In the release page: “The other model(s) in Qwen3.8-series would be released later”, we know that Qwen3.8-27B is dropping next, but that statement implies there might be other models beyond the 27B!

  • ThyTTY@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    2 days ago

    Thanks, my knowledge on the topic of Local AI is still very barebones. I generally use my FW for coding assistance, troubleshooting Linux issues, automating stuff and doing some heavy text processing (fixing artifacts after OCRing old PDFs and formatting text). I have lots of spare RAM as I’m lucky enough to have the 128GB model I bought before the prices went crazy. I need to try this Qwen3.6 and Gemma as you recommended as it looks like they may fit my needs as well. The Coder I have has been running smoothly for a while and I didn’t really have the opportunity to tinker with other options recently. If you have any tips for my use case I’m all ears!

    • Domi@lemmy.secnd.me
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 days ago

      128GB is plenty to try different models and see what works best. Have fun!

      In case you didn’t see it yet, your best friend for Strix Halo machines is https://strixhalo.wiki/

      Lots of info on how to setup llama.cpp (with pre-made toolboxes), configure the BIOS settings for maximum available VRAM and Linux for the best performance.

      I would recommend setting um llama-swap together with the Strix Halo Toolboxes with llama.cpp. So you can freely swap between models.