cs.LG, math.DS, math.OC, stat.ML

Zeroth-Order Optimization at the Edge of Stability

arXiv:2604.14669v1 Announce Type: cross
Abstract: Zeroth-order (ZO) methods are widely used when gradients are unavailable or prohibitively expensive, including black-box learning and memory-efficient fine-tuning of large models, yet their optimizatio…