Author name: /u/Few_Painter_5588

Interestingly enough, Mistral Small is written as Mistral-Small-4-119B-2603. Their medium model will have 128B paramters. Either it will be a dense model, or a less sparse MoE than Mistral Small submitted by /u/Few_Painter_5588 [l…

Their Ling 2 model was 1 Trillion Parameters with 50B active parameters. They made the same commitment for the flash model too, a 104B model with 7B active parameters submitted by /u/Few_Painter_5588 [link] [comments]