Residual-as-Teacher: Mitigating Bias Propagation in Student–Teacher Estimation
arXiv:2603.25466v1 Announce Type: new
Abstract: We study statistical estimation in a student–teacher setting, where predictions from a pre-trained teacher are used to guide a student model. A standard approach is to train the student to directly matc…