SFT-then-RL Outperforms Mixed-Policy Methods for LLM Reasoning
arXiv:2604.23747v1 Announce Type: cross
Abstract: Recent mixed-policy optimization methods for LLM reasoning that interleave or blend supervised and reinforcement learning signals report improvements over the standard SFT-then-RL pipeline. We show tha…