Author name: Yifan Zhang

arXiv:2603.16039v2 Announce Type: replace
Abstract: Recent work has made clear that the residual pathway is not mere optimization plumbing; it is part of the model’s representational machinery. We agree, but argue that the cleanest way to organize thi…

arXiv:2507.19247v5 Announce Type: replace-cross
Abstract: Autoregressive language models achieve remarkable performance, yet a unified theory explaining their internal mechanisms, how training shapes representations, and why these representations supp…