Hello everyone,
I have noticed there is no data yet what quants are better for 26B A4B and 31b. Personally, in my experience testing 26b a4b q4_k_m from Bartowski and the full version on openrouter and AI Studio, I have found this quant to perform exceptionally well. But I'm curious about your insights.
[link] [comments]