Image & vision

ExtractBench Pro (LlamaIndex)

by LlamaIndex

What is ExtractBench Pro (LlamaIndex)? ExtractBench Pro (LlamaIndex) is an image & vision eval made by LlamaIndex. The harder companion to ExtractBench, released October 2026: 100 synthetic documents (2,622 pages, 86 document types, 144,141 expected values) where many values cannot be copied from the page. They must be read off charts or drawings, counted under the document's own rules, or decoded with its own jargon. Same evaluator as ExtractBench; the headline metric is the share of documents extracted perfectly.

Page last updated 2026-10-18 · Evals Review

Editor note

The harder companion to ExtractBench, released October 2026: 100 synthetic documents (2,622 pages, 86 document types, 144,141 expected values) where many values cannot be copied from the page. They must be read off charts or drawings, counted under the document's own rules, or decoded with its own jargon. Same evaluator as ExtractBench; the headline metric is the share of documents extracted perfectly.

What it tests
Extraction systems on long-tail documents with charts, diagrams and house rules.
Original source
www.extractbench.ai/pro
Last updated
Dataset updated 2026-10-20
License
Apache-2.0

Facts come only from the linked source (checked 15–16 Oct 2026). Credit belongs to the creators. We don't score or rank evals: how we review.

Reviews

No reviews yet.

Reviews are written by people who sign in with GitHub, one per account per eval. We can't confirm that each reviewer used the eval; we remove reviews that break our rules, never just for being negative, and we never add, buy or edit reviews. Averages, when shown, come only from these reviews.

Reviews from practitioners who sign in with GitHub open soon.

Related image & vision evals

  • MMMU — Expert-level multimodal understanding and reasoning.
  • MathVista — Mathematical reasoning over figures, plots and images.
  • MMBench — Broad perception and reasoning skills of vision-language models.
  • ChartQA — Question answering over charts.

All Image & vision evals · Comparison table