This is an MoE model with 1.6T-A49B

The weights were up briefly then taken down due to some issues in the repo files apparently, now they’re back up:

GGUFs are out as well:

DeepSeek published benchmarks for reference:

  • lynx@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    2
    ·
    21 hours ago

    With Q4 everything below 150B should be fine. You can also run the -Flash variant of this model in Q1, but it is probably not usable.