Directional Consistency as a Complementary Optimization Signal: The GONO Framework
arXiv:2605.06575v1 Announce Type: cross
Abstract: We identify and formalize an underexplored phenomenon in deep learning optimization: directional alignment and loss convergence can be decoupled. An optimizer can exhibit near-perfect directional consi…