Image & vision evals

MMMU

by MMMU team (OSU, Waterloo & collaborators)

Editor note

About 11.5K college-level questions across six disciplines and 30 subjects, each pairing text with images such as charts, diagrams, maps and chemical structures.

What it tests
Expert-level multimodal understanding and reasoning.
Original source
mmmu-benchmark.github.io/
Last updated
Repo last commit 2026-07-28
License
Apache-2.0

Facts come only from the linked source (checked 15 Oct 2026). Credit belongs to the creators.

Reviews

No reviews yet.

Reviews from practitioners who sign in with GitHub open soon.