Randomly Initialized Networks Can Learn from Peer-to-Peer Consensus
arXiv:2604.18390v1 Announce Type: new
Abstract: In self-supervised learning, self-distilled methods have shown impressive performance, learning representations useful for downstream tasks and even displaying emergent properties. However, state-of-the-…