Learning Dynamics of Zeroth-Order Optimization: A Kernel Perspective
arXiv:2605.03373v1 Announce Type: new
Abstract: Classical optimization theory establishes that zeroth-order (ZO) algorithms suffer from a dimension-dependent slowdown, with convergence rates typically scaling with the model dimension compared to first…