Dynamic Scaled Gradient Descent for Stable Fine-Tuning for Classifications
arXiv:2604.27987v1 Announce Type: new
Abstract: Fine-tuning pretrained models has become a standard approach to adapting pretrained knowledge to improve the accuracy on new sparse, imbalance datasets. However, issues arise when optimization falls into…