Localizing Task Recognition and Task Learning in In-Context Learning via Attention Head Analysis
arXiv:2509.24164v2 Announce Type: replace
Abstract: We investigate the mechanistic underpinnings of in-context learning (ICL) in large language models by reconciling two dominant perspectives: the component-level analysis of attention heads and the ho…