GPQA Chemistry

reasoning official site →

Chemistry subset of GPQA, containing challenging multiple-choice questions written by domain experts in chemistry. These Google-proof questions require graduate-level knowledge and reasoning.

Methodology

Imported from llm-stats public benchmark metadata. Modality: text. Max score: 1. Categories: chemistry, reasoning. Language: en. Verified by llm-stats: no.

Leaderboard

  1. o1 self-reported llm-stats
    64.7%