Listen and Chant Before You Read: The Ladder of Beauty in LM Pre-Training
arXiv:2604.21265v1 Announce Type: new
Abstract: We show that pre-training a Transformer on music before language significantly accelerates language acquisition. Using piano performances (MAESTRO dataset), a developmental pipeline — music $\to$ poetry…