A Basin-Selection Perspective on Grokking via Singular Learning Theory
arXiv:2603.01192v3 Announce Type: replace
Abstract: Grokking, the abrupt transition from memorization to generalisation after extended training, suggests the presence of competing solution basins with distinct statistical properties. We study this phe…