Tracing the complexity profiles of different linguistic phenomena through the intrinsic dimension of LLM representations
arXiv:2601.03779v2 Announce Type: replace
Abstract: We explore intrinsic dimension (ID) of LLM representations as a marker of linguistic complexity. Specifically, we test whether ID differences across model layers reflect well-known complexity contras…