Author name: Annette Taberner-Miller

arXiv:2604.00136v2 Announce Type: replace
Abstract: Multi-model LLM serving operates in a non-stationary, noisy environment: providers revise pricing, model quality can shift or regress without notice, and new models arrive regularly. More than a doze…

arXiv:2604.00136v1 Announce Type: cross
Abstract: Production LLM serving often relies on multi-model portfolios spanning a ~530x cost range, where routing decisions trade off quality against cost. This trade-off is non-stationary: providers revise pri…