Coding

SWE-bench

by Princeton NLP & collaborators

Editor note

Gives a model a real GitHub issue from an open-source Python project and checks whether its code change makes the project's tests pass.

What it tests
Fixing real bugs in real repositories, judged by unit tests.
Original source
www.swebench.com/
Last updated
Not checked yet
License
Not checked yet — see source

Facts come only from the linked source (checked 15 Oct 2026). Credit belongs to the creators.

Reviews

No reviews yet.

Reviews from practitioners who sign in with GitHub open soon.