Author name: Wenshuo Wang

arXiv:2604.25110v1 Announce Type: new
Abstract: This position paper argues that knowledge distillation must account for what it loses: student models should be judged not only by retained task scores, but by whether they preserve the teacher capabilit…