STABLEVAL: Disagreement-Aware and Stable Evaluation of AI Systems
arXiv:2605.02122v1 Announce Type: cross
Abstract: Human evaluation remains the primary standard for assessing modern AI systems, yet annotator disagreement, bias, and variability make system rankings fragile under standard majority vote aggregation. M…