MT-Bench (LLM-as-a-judge paper)

by LMSYS

Editor note

The paper that popularised using a strong model as a judge, with multi-turn questions and an analysis of where judges agree with humans and where they are biased.

What it tests: Multi-turn conversation quality; how reliable LLM judges are.
Original source: arxiv.org/abs/2306.05685
Last updated: Not checked yet
License: Not checked yet — see source

Facts come only from the linked source (checked 15 Oct 2026). Credit belongs to the creators.

Reviews

No reviews yet.

Reviews from practitioners who sign in with GitHub open soon.