• rmrf@lemmy.ml
    link
    fedilink
    English
    arrow-up
    4
    ·
    8 hours ago

    You’re telling me that is routing requests through a model 70x the price?

    • Womble@piefed.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      21 hours ago

      You almost certainly weren’t using a Deepseek model offline (unless you have 100s of GB of RAM/VRAM). You might have been using a small model distilled on Deepseek responses, but the smallest model made by Deepseek is about a 300B param model.

      • SteveTech@aussie.zone
        link
        fedilink
        English
        arrow-up
        10
        ·
        20 hours ago

        the smallest model made by Deepseek is about a 300B param model.

        This is not correct. DeepSeek has plenty of smaller models. I just had a scroll through their huggingface, and picked out a few: DeepSeek-V2-Lite (16B), deepseek-moe-16b-chat, deepseek-llm-7b-chat, but there’s quite a few more too.

        Though DeepSeek R1 is their flagship model, which is the one people usually think of, and that’s a 684B param model.

        • Womble@piefed.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          edit-2
          3 minutes ago

          huh fair enough, I hadn’t seen those before, they’re from before deepseek made a name for themselves (which as you say was with R1). They are very out of date though, as is R1 (from the end of 2024 and start of 2025 respectively). the current set of models from Deepseek come in 291B and 1.6T varieties and the previous version only was released in 685B

          You’d almost certainly be better off upgrading to qwen or Gemma4 for a local model of that kind of size.

    • Zetta@mander.xyz
      link
      fedilink
      English
      arrow-up
      8
      ·
      1 day ago

      I love open Chinese llms but this seems 100% plausible and and I think ur wring. This is in line with how Chinese companies need to work around the system since America tries to handicap them. This is actually a very smart way to get high quality trianjng data for their future models. Unfortunate about leaking private customer data to a us company though.

      Also the article and the evidence presented by Antropic all seems very plausible.

  • francisco_1844@discuss.online
    link
    fedilink
    English
    arrow-up
    11
    ·
    1 day ago

    What this really boils down to is that Anthropic and OpenAI hope to be the only ones that use someone else’s copyrighted information without any legal or financial complications.

  • esc@piefed.social
    link
    fedilink
    English
    arrow-up
    9
    ·
    1 day ago

    Alright, so what? Also this (even if it’s true and not another clown show by claude) won’t affect models that aren’t hosted by moonshot or deepseek.