Topological Signatures of Grokking
arXiv:2605.06352v1 Announce Type: cross
Abstract: We study the grokking phenomenon through the lens of topology. Using persistent homology on point clouds derived from the embedding matrices of a range of models trained on modular arithmetic with vary…