OP-GRPO: Efficient Off-Policy GRPO for Flow-Matching Models
arXiv:2604.04142v1 Announce Type: new
Abstract: Post training via GRPO has demonstrated remarkable effectiveness in improving the generation quality of flow-matching models. However, GRPO suffers from inherently low sample efficiency due to its on-pol…