cs.AI, cs.LG, stat.ME

Query-efficient model evaluation using cached responses

arXiv:2605.07096v1 Announce Type: new
Abstract: Evaluating a new model on an existing benchmark is often necessary to understand its behavior before deployment. For modern evaluation frameworks, generating and evaluating a response for all queries can…