ThyTTY

Thank you, I will check this out. So what I got from this is that the speed may be slower but results should be more accurate?

Hey, I also have a Strix Halo box. Which model are you running exactly? The Q8 and BF16 are half the size of Qwen3-Coder-Next-UD-Q8 I have been running before. I tested 3.8-BF16 and UD-Q8 but both run at abysmal speed in comparison to Coder Next (around 8 t/s during chat). Which one gives you best results?

Thanks, my knowledge on the topic of Local AI is still very barebones. I generally use my FW for coding assistance, troubleshooting Linux issues, automating stuff and doing some heavy text processing (fixing artifacts after OCRing old PDFs and formatting text). I have lots of spare RAM as I’m lucky enough to have the 128GB model I bought before the prices went crazy. I need to try this Qwen3.6 and Gemma as you recommended as it looks like they may fit my needs as well. The Coder I have has been running smoothly for a while and I didn’t really have the opportunity to tinker with other options recently. If you have any tips for my use case I’m all ears!

Thanks. So you’re saying Qwen 3.5-122b has more knowledge than 3.8-27B? Did I get this right?

Can someone give me an ELI5 what’s the difference between 27B and this 2.4T? Is it mostly size? I have a Framework Desktop which has been running 3.5-Coder Next for a while, not sure if I should switch

He’s either a dickhead or didn’t want stranded to see what was happening on his yacht. Most probably both