Sharp description of local minima in the loss landscape of high-dimensional two-layer ReLU neural networks
arXiv:2604.09412v1 Announce Type: cross
Abstract: We study the population loss landscape of two-layer ReLU networks of the form $\sum_{k=1}^K \mathrm{ReLU}(w_k^\top x)$ in a realisable teacher-student setting with Gaussian covariates. We show that loc…