PaperBench

coding

PaperBench is a benchmark for evaluating AI agents on their ability to replicate research papers. It tests models on complex, multi-step workflows involving code implementation, experimentation, and reproducing scientific results from academic publications.

Leaderboard

  1. 63.5%
  2. 52.6%