Concepts Whisper While Syntax Shouts: Spectral Anti-Concentration and the Dual Geometry of Transformer Representations
arXiv:2605.01609v1 Announce Type: cross
Abstract: We test whether the causal inner product of \citet{park2024linear} — defined by the unembedding covariance $\Sigma$ — enables cross-lingual concept transport. Across 17 models and 4 language pairs, a…