RULER

Multilingual: no

RULER v1 is a synthetic long-context benchmark for measuring how model quality degrades as input length increases. This packaging follows the public standalone NVIDIA RULER implementation with 13 official tasks spanning retrieval, multi-hop tracing, aggregation, and QA.

Methodology

Imported from llm-stats public benchmark metadata. Modality: text. Max score: 1. Categories: long_context, reasoning. Language: en. Verified by llm-stats: no.

Leaderboard

Showing 3 of 3 results

Nemotron 3 Super (120B A12B) self-reported llm-stats

91.8%
Phi-3.5-MoE-instruct self-reported llm-stats

87.1%
Phi-3.5-mini-instruct self-reported llm-stats

84.1%