Writing & instruction following

AlpacaEval

by Stanford Tatsu Lab

Editor note

Compares a model's answers against a reference model's answers using an automatic LLM judge, with a correction for judges that prefer longer answers.

What it tests
General helpfulness of chat responses.
Original source
github.com/tatsu-lab/alpaca_eval
Last updated
Repo last commit 2025-08-09
License
Apache-2.0

Facts come only from the linked source (checked 15 Oct 2026). Credit belongs to the creators.

Reviews

No reviews yet.

Reviews from practitioners who sign in with GitHub open soon.