RVPO: Risk-Sensitive Alignment via Variance Regularization
arXiv:2605.05750v1 Announce Type: cross
Abstract: Current critic-less RLHF methods aggregate multi-objective rewards via an arithmetic mean, leaving them vulnerable to constraint neglect: high-magnitude success in one objective can numerically offset …