From Early Encoding to Late Suppression: Interpreting LLMs on Character Counting Tasks
arXiv:2604.00778v1 Announce Type: new
Abstract: Large language models (LLMs) exhibit failures on elementary symbolic tasks such as character counting in a word, despite excelling on complex benchmarks. Although this limitation has been noted, the inte…