HumanEval

by OpenAI

Editor note

A classic set of hand-written Python function problems, each checked by running hidden tests. Useful as a baseline, though top models have largely mastered it.

What it tests: Writing a short correct function from a docstring.
Original source: github.com/openai/human-eval
Last updated: Repo last commit 2025-01-17
License: MIT

Facts come only from the linked source (checked 15 Oct 2026). Credit belongs to the creators.

Reviews

No reviews yet.

Reviews from practitioners who sign in with GitHub open soon.