cs.AI, cs.LG, math.OC, stat.ML

A Rod Flow Model for Adam at the Edge of Stability

arXiv:2605.06821v1 Announce Type: cross
Abstract: Cohen et al. (arXiv:2207.14484) observed that adaptive gradient methods such as Adam operate at the edge of stability. While there has been significant work on continuous-time modeling of gradient desc…