SimpleQA Verified

reasoning official site →

SimpleQA Verified is a curated, reliability-focused subset of SimpleQA that addresses label noise and redundancy in the original benchmark, measuring short-form parametric factual accuracy of large language models on fact-seeking questions with single, indisputable answers.

Methodology

Imported from llm-stats public benchmark metadata. Modality: text. Max score: 1. Categories: factuality, general, reasoning. Language: en. Verified by llm-stats: no.

Leaderboard

  1. MAI-Thinking-1 self-reported llm-stats
    31.0%