The Geometric Alignment Tax: Tokenization vs. Continuous Geometry in Scientific Foundation Models
arXiv:2604.04155v1 Announce Type: cross
Abstract: Foundation models for biology and physics optimize predictive accuracy, but their internal representations systematically fail to preserve the continuous geometry of the systems they model. We identify…