I am looking at a product that will do runtime quant on DeepSeek V3.2. I want to measure quality loss compared to no quant. What kind of benchmarks can I run?
[link] [comments]
Need Info on quality benchmarks to run on DeepSeek V3.2 different quant levels [D]
submitted by /u/Chachachaudhary123
[link] [comments]