Author name: Yiheng Zhang, Yiming Wang, Kaiyan Zhao, Zhenglin Wan, Jiayu Chen, Leong Hou U

arXiv:2605.02320v1 Announce Type: new
Abstract: Proximal Policy Optimization (PPO) dominates deep RL but faces a fundamental dilemma. Its “hard clipping” mechanism discards valuable gradient information from outliers, leading to sample inefficiency. C…