Introducing cyankiwi AWQ 4-bit Quantization — 26.05 update
In standard AWQ, per-channel scales and quantization ranges are picked in separate steps: scales first, then the quantization parameters. But they're not independent, i.e., the rounding error from one depends on the choice of the other, so op…