Author name: Hassan Dbouk, Nidham Gazagnadou, Matthias Reisser, Christos Louizos

arXiv:2605.03869v1 Announce Type: new
Abstract: We investigate the effectiveness of adaptive zeroth-order (ZO) optimization for memory-constrained fine-tuning of large language models (LLMs). Contrary to prior claims, we show that adaptive ZO methods …