French MMLU

reasoning official site →

French version of MMLU-Pro, a multilingual benchmark for evaluating language models' cross-lingual reasoning capabilities across 14 diverse domains including mathematics, physics, chemistry, law, engineering, psychology, and health.

Methodology

Imported from llm-stats public benchmark metadata. Modality: text. Max score: 1. Categories: finance, general, healthcare, language, legal, reasoning. Language: en. Verified by llm-stats: no.

Leaderboard

  1. Ministral 8B Instruct self-reported llm-stats
    57.5%