Position: LLM Serving Needs Mathematical Optimization and Algorithmic Foundations, Not Just Heuristics
arXiv:2605.01280v1 Announce Type: cross
Abstract: This position paper argues that LLM inference serving has outgrown generic heuristics and now demands mathematical optimization and algorithmic foundations. Despite rapid advances in serving systems su…