Activation Saturation and Floquet Spectrum Collapse in Neural ODEs
arXiv:2604.00543v1 Announce Type: cross
Abstract: We prove that activation saturation imposes a structural dynamical limitation on autonomous Neural ODEs $\dot{h}=f_\theta(h)$ with saturating activations ($\tanh$, sigmoid, etc.): if $q$ hidden layers …