Implicit Representations of Grammaticality in Language Models
arXiv:2605.05197v1 Announce Type: new
Abstract: Grammaticality and likelihood are distinct notions in human language. Pretrained language models (LMs), which are probabilistic models of language fitted to maximize corpus likelihood, generate grammatic…