I taught my 1B to follow instructions. It got worse at following instructions…
Same SFT recipe (SlimOrca 50K, LoRA r=16, 1 epoch). Three models trained from scratch at 1B, 2B, and 3B parameters. IFEval before and after: Model Base After SFT Delta 1B 20.50 14.75 -5.75 2B 21.94 17.03 -4.91 3B 23.14 25.18 +2.04 OK so SFT …