I've tested 3 models:
- gemma4-26B-A4B-it-UD-Q4_K_M
- gemma4-31B-it-Q4_K_M
- qwen3.6-35B-A3B-UD-IQ4_XS
Asked following question:
We developing a Godot 4 3D RPG game. First task would be to make a professional and smooth 3rd person camera controller. Plan a scene tree node structure for it. Use best game development practices. Plan only, without code.
Gemma4's output was very reasonable and working plans, but Qwen3.6 output was horrible. It looks totally random and has nothing common with reality.
gemma4-26B-A4B-it-UD-Q4_K_M
gemma4-31B-it-Q4_K_M
qwen3.6-35B-A3B-UD-IQ4_XS
Does anyone know why Qwen3.6 has such a poor performance? I know it's made in China, maybe Godot isn't known very much there? Have you guys experinced this poor performance from Qwen3.6 compared to Gemma4? Or maybe I'm doing something wrong? Qwen model didn't even added SpringArm3D node, which is one of the most important nodes.
My llama.cpp command for Qwen is:
../program/llama-server \ -m ../GGUF/Qwen3.6-35B-A3B-UD-IQ4_XS.gguf \ --chat-template-kwargs '{"preserve_thinking": true}' \ -c 16384 \ -fa on \ -t 6 \ --jinja
