Weak-to-Strong Knowledge Distillation Accelerates Visual Learning
arXiv:2604.15451v1 Announce Type: new
Abstract: Large-scale visual learning is increasingly limited by training cost. Existing knowledge distillation methods transfer from a stronger teacher to a weaker student for compression or final-accuracy improv…