Pre-training Scaling Stopped Being the Whole Recipe

By Marc Bara / April 23, 2026

Public reports from SmolLM3, Kimi K2, DeepSeek, and NVIDIA’s Nemotron 3 point to four recurring shifts in how open models are now built.