It’s insane how lobotomized Opus 4.6 is right now. Even Gemma 4 31B UD IQ3 XXS beat it on the carwash test on my 5070 TI.
submitted by /u/FrozenFishEnjoyer [link] [comments]
LocalLLaMA
LocalLLaMA
I finally found the best 5070 TI + 32GB ram GGUF model
it's the Gemma 4 26B A3B IQ4 NL. My llama.cpp command is: llama-server.exe -m "gemma-4-26B-A4B-it-UD-IQ4_NL.gguf" -ngl 999 -fa on -c 65536 -ctk q8_0 -ctv q8_0 –batch-size 1024 –ubatch-size 512 –temp 1.0 –top-k 64 –top-p 0.95 –min-p…