Sigmoid Head for Quality Estimation under Language Ambiguity
arXiv:2601.00680v2 Announce Type: replace
Abstract: Language model (LM) probability is not a reliable quality estimator, as natural language is ambiguous. When multiple output options are valid, the model’s probability distribution is spread across th…