cs.LG, math.OC, stat.ML

A short proof of near-linear convergence of adaptive gradient descent under fourth-order growth and convexity

arXiv:2604.13393v1 Announce Type: cross
Abstract: Davis, Drusvyatskiy, and Jiang showed that gradient descent with an adaptive stepsize converges locally at a nearly-linear rate for smooth functions that grow at least quartically away from their minim…