Learning State-Tracking from Code Using Linear RNNs
arXiv:2602.14814v2 Announce Type: replace-cross
Abstract: Over the last years, state-tracking tasks, particularly permutation composition, have become a testbed to understand the limits of sequence models architectures like Transformers and RNNs (line…