R\’enyi Entropy: A New Token Pruning Metric for Vision Transformers
arXiv:2603.27900v1 Announce Type: new
Abstract: Vision Transformers (ViTs) achieve state-of-the-art performance but suffer from the $O(N^2)$ complexity of self-attention, making inference costly for high-resolution inputs. To address this bottleneck, …