SWE-bench-Live

by Microsoft Research & collaborators

Editor note

A continuously updated version of SWE-bench: real GitHub issues with Docker sandboxes, now covering multiple languages and operating systems, with new verified tasks added over time.

What it tests: Fixing live software issues across languages and platforms, judged by tests in Docker.
Original source: swe-bench-live.github.io/
Last updated: Repo last commit 2026-09-25
License: MIT

Facts come only from the linked source (checked 15 Oct 2026). Credit belongs to the creators.

Reviews

No reviews yet.

Reviews from practitioners who sign in with GitHub open soon.