Scaling Laws from Sequential Feature Recovery: A Solvable Hierarchical Model
arXiv:2605.14567v1 Announce Type: new
Abstract: We propose a simple mechanism by which scaling laws emerge from feature learning in multi-layer networks. We study a high-dimensional hierarchical target that is a globally high-degree function, but that…