Neural Collapse Dynamics: Depth, Activation, Regularisation, and Feature Norm Threshold
arXiv:2604.00230v1 Announce Type: new
Abstract: Neural collapse (NC) — the convergence of penultimate-layer features to a simplex equiangular tight frame — is well understood at equilibrium, but the dynamics governing its onset remain poorly charact…