Relational reasoning and inductive bias in transformers and large language models
arXiv:2506.04289v3 Announce Type: replace
Abstract: Transformer-based models have demonstrated remarkable reasoning abilities, but the mechanisms underlying relational reasoning remain poorly understood. We investigate how transformers perform \textit…