0.27.136.404I srv proxy_reques: proxying request to model unsloth/Qwen3.8-27B-GGUF:Q4_K_M on port 55741
[55741] 0.14.424.772W srv operator(): got exception: {"error":{"code":500,"message":"\n------------\nWhile executing CallExpression at line 106, column 32 in source:\n...first %}↵ {{- raise_exception('System message must be at the beginnin...\n ^\nError: Jinja Exception: System message must be at the beginning.","type":"server_error"}}
Having issues with it (Unsloth’s gguf).
0.27.136.404 I srv proxy_reques: proxying request to model unsloth/Qwen3.8-27B-GGUF:Q4_K_M on port 55741 [55741] 0.14.424.772 W srv operator(): got exception: {"error":{"code":500,"message":"\n------------\nWhile executing CallExpression at line 106, column 32 in source:\n...first %}↵ {{- raise_exception('System message must be at the beginnin...\n ^\nError: Jinja Exception: System message must be at the beginning.","type":"server_error"}}Got an answer - there were indeed issue with some quants
All quants updated with correct template now
Waiting for 2 or 3 such iteration before testing it on my gear, but thanks for your services, brave frontier soldier o7
That’s why I didn’t have any issues. Added the entry to my llama-server model ini and it Just worked. Great job and much appreciate your work!
Sounds like you could just replace the template to fix it, there’s a popular Qwen fixed template on hugging face, try that
https://huggingface.co/froggeric/Qwen-Fixed-Chat-Templates/blob/main/chat_template.jinja