cs.AI, cs.CL, cs.CV, cs.LG

E = T*H/(O+B): A Dimensionless Control Parameter for Mixture-of-Experts Ecology

arXiv:2605.06415v1 Announce Type: cross
Abstract: We introduce E = T*H/(O+B), a dimensionless control parameter that predicts whether Mixture-of-Experts (MoE) models will develop a healthy expert ecology or collapse into dead experts. E combines four …