On the Expressive Power of Contextual Relations in Transformers
arXiv:2603.25860v1 Announce Type: new
Abstract: Transformer architectures have achieved remarkable empirical success in modeling contextual relationships in natural language, yet a precise mathematical characterization of their expressive power remain…