Lost in State Space: Probing Frozen Mamba Representations
arXiv:2605.00253v1 Announce Type: new
Abstract: Mamba’s recurrent state h_t is, by construction, a compressed summary of every token seen so far. This raises a tempting hypothesis: if we extract token-level outputs y_t at fixed patch boundaries, we ob…