Revisiting a Pain in the Neck: A Semantic Reasoning Benchmark for Language Models
arXiv:2604.16593v1 Announce Type: new
Abstract: We present SemanticQA, an evaluation suite designed to assess language models (LMs) in semantic phrase processing tasks. The benchmark consolidates existing multiword expression (MwE) resources and reorg…