Multilingual MGSM (CoT)

Multilingual: no

Multilingual Grade School Math (MGSM) benchmark evaluates language models' chain-of-thought reasoning abilities across ten typologically diverse languages. Contains 250 grade-school math problems manually translated from GSM8K dataset into languages including Bengali and Swahili.

Methodology

Imported from llm-stats public benchmark metadata. Modality: text. Max score: 1. Categories: math, reasoning. Language: en. Verified by llm-stats: no.

Leaderboard

Showing 3 of 3 results

Llama 3.1 405B Instruct self-reported llm-stats

91.6%
Llama 3.1 70B Instruct self-reported llm-stats

86.9%
Llama 3.1 8B Instruct self-reported llm-stats

68.9%