Suspicious Alignment of SGD: A Fine-Grained Step Size Condition Analysis
arXiv:2601.11789v2 Announce Type: replace
Abstract: This paper explores the suspicious alignment phenomenon in stochastic gradient descent (SGD) under ill-conditioned optimization, where the Hessian spectrum splits into dominant and bulk subspaces. Th…