e0qdk@reddthat.com to LocalLLaMA@sh.itjust.worksEnglish · 1 day agoQwen3.8-27B Weights Releasedhuggingface.coexternal-linkmessage-square19fedilinkarrow-up159arrow-down13
arrow-up156arrow-down1external-linkQwen3.8-27B Weights Releasedhuggingface.coe0qdk@reddthat.com to LocalLLaMA@sh.itjust.worksEnglish · 1 day agomessage-square19fedilink
minus-squarefubarx@lemmy.worldlinkfedilinkEnglisharrow-up2·1 day agoOn a DGX with 128G unified I could push Qwen3.6-27B to 8-bit and it had pretty decent response. It just croaked with MLX on the Mac. Waiting to see what Apple announces next month. Judging by RAM prices, it’ll be waaay outside my budget.
On a DGX with 128G unified I could push Qwen3.6-27B to 8-bit and it had pretty decent response. It just croaked with MLX on the Mac.
Waiting to see what Apple announces next month. Judging by RAM prices, it’ll be waaay outside my budget.