SparseRL-Sync: Lossless Weight Synchronization with ~100x Less Communication
arXiv:2605.07330v1 Announce Type: cross
Abstract: In large-scale reinforcement learning (RL) systems with decoupled Trainer-Rollout execution, the Trainer must regularly synchronize policy weights to the Rollout side to limit policy staleness. When in…