Slot Machines: How LLMs Keep Track of Multiple Entities
arXiv:2604.21139v1 Announce Type: new
Abstract: Language models must bind entities to the attributes they possess and maintain several such binding relationships within a context. We study how multiple entities are represented across token positions a…