Estimating Implicit Regularization in Deep Learning
arXiv:2605.05436v1 Announce Type: new
Abstract: Deep learning systems are known to exhibit implicit regularization (alt. implicit bias), favoring simple solutions instead of merely minimizing the loss function. In some cases, we can analytically deriv…