How Long Does Infinite Width Last? Signal Propagation in Long-Range Linear Recurrences
arXiv:2605.05113v1 Announce Type: new
Abstract: We study signal propagation in linear recurrent models at finite width. While existing signal propagation theory relies predominantly on the infinite-width limit, it remains unclear for how long that app…