Correction of Decoupled Weight Decay
arXiv:2512.08217v3 Announce Type: replace
Abstract: Decoupled weight decay, solely responsible for the performance advantage of AdamW over Adam, has long been set to proportional to learning rate $\gamma$ without questioning. Some researchers have rec…