LPC-SM: Local Predictive Coding and Sparse Memory for Long-Context Language Modeling
arXiv:2604.03263v1 Announce Type: new
Abstract: Most current long-context language models still rely on attention to handle both local interaction and long-range state, which leaves relatively little room to test alternative decompositions of sequence…