The Predictive-Causal Gap: An Impossibility Theorem and Large-Scale Neural Evidence
arXiv:2605.05029v1 Announce Type: new
Abstract: We report a systematic failure mode in predictive representation learning. Across 2695 neural network configurations trained to predict linear-Gaussian dynamics, the optimal encoder tracks the environmen…