Colinearity Decay: Training Quantization-Friendly ViTs with Outlier Decay
arXiv:2605.01330v1 Announce Type: new
Abstract: Low-bit quantization is a practical route for efficiently deploying vision Transformers, yet activation outliers complicate fully quantized deployment. Existing methods either handle quantization post-tr…