Why Training-Free Token Reduction Collapses: The Inherent Instability of Pairwise Scoring Signals
arXiv:2604.16745v1 Announce Type: cross
Abstract: Training-free token reduction methods for Vision Transformers (ToMe, ToFu, PiToMe, and MCTF) employ different scoring mechanisms, yet they share a closely matched cliff-like collapse at high compressio…