Why Local Minima Aren’t the Problem We Thought They Were

Visualizing the hidden low-loss paths that connect different neural network solutions.