SimpleQA

Editor note

4,326 short fact questions with one indisputable answer each; rewards models that answer correctly or admit they don't know instead of hallucinating.

What it tests

Short-form factuality and calibration.

Original source

openai.com/index/introducing-simpleqa/

Last updated

Published 2024-10-30

License

Not checked yet — see source

Facts come only from the linked source (checked 15 Oct 2026). Credit belongs to the creators.

Reviews

No reviews yet.

Reviews from practitioners who sign in with GitHub open soon.