I built a self-evolving MoE from scratch that triggers "neurogenesis" on distribution shifts (MPS native). Looking for architecture roasts. [P]
I don't have a formal ML or research background, but I wanted to understand dynamic architectures, so I tried building a Mixture of Experts (MoE) model that physically grows instead of just failing when the data changes. It's called the Self-Ev…