The Long Delay to Arithmetic Generalization: When Learned Representations Outrun Behavior
arXiv:2604.13082v1 Announce Type: cross
Abstract: Grokking in transformers trained on algorithmic tasks is characterized by a long delay between training-set fit and abrupt generalization, but the source of that delay remains poorly understood. In enc…