RealKIE-FCC

multimodal official site →

RealKIE-FCC is a key information extraction benchmark drawn from real enterprise documents (FCC filings), part of the RealKIE suite of five novel datasets for enterprise key information extraction. Models must convert documents to markdown and extract structured fields against a specified JSON schema. Nova 2 reports results on a human-verified version of the dataset.

Methodology

Imported from llm-stats public benchmark metadata. Modality: multimodal. Max score: 1. Categories: document_understanding, multimodal, vision. Language: en. Verified by llm-stats: no.

Leaderboard

  1. Nova 2 Pro self-reported llm-stats
    67.0%
  2. Nova 2 Lite self-reported llm-stats
    62.1%
  3. Nova 2 Omni self-reported llm-stats
    59.8%