Glad they set a time rather than leaving it open

  • SirDimples@programming.devOP
    link
    fedilink
    English
    arrow-up
    4
    ·
    3 days ago

    No you don’t need a data center, this can run on any current gaming PC with a GPU that has 16GB+ VRAM.

    Although to get good token generation speed and full context you need at least 24GB VRAM.