Zeroth-Order Optimization at the Edge of Stability
arXiv:2604.14669v1 Announce Type: cross
Abstract: Zeroth-order (ZO) methods are widely used when gradients are unavailable or prohibitively expensive, including black-box learning and memory-efficient fine-tuning of large models, yet their optimizatio…