From Cursed to Competitive: Closing the ZO-FO Gap via Input-to-State Stability
arXiv:2604.25372v1 Announce Type: cross
Abstract: While it is generally understood that zeroth-order (ZO) algorithms have an extra dependency on their number of iterations for any choice of parameters, compared to their first-order (FO) counterparts, …