Stochastic Attention: Connectome-Inspired Randomized Routing for Expressive Linear-Time Attention
arXiv:2604.00754v1 Announce Type: new
Abstract: The whole-brain connectome of a fruit fly comprises over 130K neurons connected with a probability of merely 0.02%, yet achieves an average shortest path of only 4.4 hops. Despite being highly structured…