Ministral 8B Instruct

The Ministral-8B-Instruct-2410 is an instruct fine-tuned model for local intelligence, on-device computing, and at-the-edge use cases, significantly outperforming existing models of similar size.

Benchmark results

Benchmark Score Tags Source
AGIEval 48.3% self-reported llm-stats link →
ARC-C 71.9% self-reported llm-stats link →
Arena Hard 70.9% self-reported llm-stats link →
French MMLU 57.5% self-reported llm-stats link →
HumanEval 34.8% self-reported llm-stats link →
MATH 54.5% self-reported llm-stats link →
MBPP pass@1 70.0% self-reported llm-stats link →
MMLU 65.0% self-reported llm-stats link →
MT-Bench 83 self-reported llm-stats link →
TriviaQA 65.5% self-reported llm-stats link →
Winogrande 75.3% self-reported llm-stats link →