Adaptive Computation Depth via Learned Token Routing in Transformers
arXiv:2605.05222v1 Announce Type: cross
Abstract: Standard transformer architectures apply the same number of layers to every token regardless of contextual difficulty. We present Token-Selective Attention (TSA), a learned per-token gate on residual u…