Projected Autoregression: Autoregressive Language Generation in Continuous State Space
arXiv:2601.04854v3 Announce Type: replace
Abstract: Standard autoregressive language models generate text by repeatedly selecting a discrete next token, coupling prediction with irreversible commitment at every step. We show that token selection is no…