Mixture of Experts: From Intuition to Training Reality

By Arunim / May 2, 2026

This blog is based on what I learnt from the Stanford CS336N Lecture 4 on Mixture of Experts, along with the key papers explained in the…