AdaCubic: An Adaptive Cubic Regularization Optimizer for Deep Learning
arXiv:2604.09437v1 Announce Type: new
Abstract: A novel regularization technique, AdaCubic, is proposed that adapts the weight of the cubic term. The heart of AdaCubic is an auxiliary optimization problem with cubic constraints that dynamically adjust…