• troed@fedia.io
    link
    fedilink
    arrow-up
    7
    ·
    1 day ago

    Got an answer - there were indeed issue with some quants

    Actually edit - UD-Q4_K_XL and all UD-* has our corrected chat teaplate

    We need to update the non UD-* ones with our chat template - stay tuned

    • notfromhere@lemmy.ml
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 day ago

      That’s why I didn’t have any issues. Added the entry to my llama-server model ini and it Just worked. Great job and much appreciate your work!