• fubarx@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 day ago

    On a DGX with 128G unified I could push Qwen3.6-27B to 8-bit and it had pretty decent response. It just croaked with MLX on the Mac.

    Waiting to see what Apple announces next month. Judging by RAM prices, it’ll be waaay outside my budget.