Qwen3.5-4B GGUF quants comparison (KLD vs speed) – Lunar Lake
I wanted to know which type of quant is the best on this laptop (Intel 258V – iGPU 140V 18GB), so I tested all these small quants hoping that it generalizes to bigger models: Winners in bold (KLD≤0.01) Uploader Quant tk/s KLD GB KLD/GB* mr…