TurboAngle: Near-Lossless KV Cache Compression via Uniform Angle Quantization
arXiv:2603.27467v1 Announce Type: new
Abstract: We compress KV cache entries by quantizing angles in the Fast Walsh-Hadamard domain, where a random diagonal rotation makes consecutive element pairs approximately uniformly distributed on the unit circl…