Why Optimizer Choice Matters More Than You Think: A CNN Case Study on CIFAR-10

An empirical investigation isolating optimization dynamics to understand what truly drives deep learning generalization