When Context Sticks: Studying Interference in In-Context Learning
arXiv:2604.23371v1 Announce Type: new
Abstract: This paper investigates context stickiness in in-context learning (ICL), a phenomenon where earlier examples in a prompt interfere with a transformer’s ability to adapt to later tasks. Using synthetic re…