Weak-to-Strong Generalization is Nearly Inevitable (in Linear Models)
arXiv:2605.05742v1 Announce Type: new
Abstract: Weak-to-strong generalization is a phenomenon in post-training whereby a strong student model, when finetuned solely with feedback from a weaker teacher, can not only surpass the teacher, but can improve…