I run both of them at Q8, unquantized KV cache and same settings.
35b does really well at most tasks but once the dependencies get complicated and the tool calls reach into the hundreds, 35b struggles where 27b still excels.
So generally I use 27b unless I need it fast, then I swap to 35b or 122b depending on what I need.
I run both of them at Q8, unquantized KV cache and same settings.
35b does really well at most tasks but once the dependencies get complicated and the tool calls reach into the hundreds, 35b struggles where 27b still excels.
So generally I use 27b unless I need it fast, then I swap to 35b or 122b depending on what I need.