> Mistral Small 4 is way worse than Gemma 4 26B A4B
Depends for what purpose? I found large Mistrals are massively better than Gemma 4 at creative writing: have more natural tone, better consistency than 26B as it is MoE.
Mistral Small 4 is also a MoE model, with way more params, so I would expect it to perform better. Our benchmark involves around 10% communication and writing in German and English and Gemma 4 26B A4B beats it although creative writing is the only category in our benchmark which might be a bit subjective.
Depends for what purpose? I found large Mistrals are massively better than Gemma 4 at creative writing: have more natural tone, better consistency than 26B as it is MoE.