On the Role of Depth in the Expressivity of RNNs
arXiv:2604.02201v1 Announce Type: new
Abstract: The benefits of depth in feedforward neural networks are well known: composing multiple layers of linear transformations with nonlinear activations enables complex computations. While similar effects are…