The Impossibility Triangle of Long-Context Modeling
arXiv:2605.05066v1 Announce Type: cross
Abstract: We identify and prove a fundamental trade-off governing long-sequence models: no model can simultaneously achieve (i) per-step computation independent of sequence length (Efficiency), (ii) state size i…