Mistral Small 3.2 24B Instruct

Mistral-Small-3.2-24B-Instruct-2506 is a minor update of Mistral-Small-3.1-24B-Instruct-2503.

Benchmark results

Benchmark Score Tags Source
AI2D 92.9% self-reported llm-stats link →
Arena Hard 43.1% self-reported llm-stats link →
ChartQA 87.4% self-reported llm-stats link →
DocVQA 94.9% self-reported llm-stats link →
GPQA 46.1% self-reported llm-stats link →
GPQA 46.1% self-reported llm-stats link →
HumanEval Plus 92.9% self-reported llm-stats link →
IF 84.8% self-reported llm-stats link →
MATH 69.4% self-reported llm-stats link →
MathVista 67.1% self-reported llm-stats link →
MBPP Plus 78.3% self-reported llm-stats link →
MMLU 80.5% self-reported llm-stats link →
MMLU-Pro 69.1% self-reported llm-stats link →
MMMU 62.5% self-reported llm-stats link →
SimpleQA 12.1% self-reported llm-stats link →
Wild Bench 65.3% self-reported llm-stats link →