How Much Is One Recurrence Worth? Iso-Depth Scaling Laws for Looped Language Models
arXiv:2604.21106v1 Announce Type: cross
Abstract: We measure how much one extra recurrence is worth to a looped (depth-recurrent) language model, in equivalent unique parameters. From an iso-depth sweep of 116 pretraining runs across recurrence counts…