Writing & instruction following evals
CodingAgents & tool useCustomer supportWriting & instruction followingSafety & factualityHealthcareMultilingual & Indian languagesRAG & retrievalReasoning & knowledgeRubric libraries & frameworks
Writing & instruction following
EQ-Bench Creative Writing
Scores creative writing from models with an LLM judge using a detailed rubric, aiming to capture quality rather than just correctness.
Writing & instruction followingAlpacaEval
Compares a model's answers against a reference model's answers using an automatic LLM judge, with a correction for judges that prefer longer answers.
Writing & instruction followingMT-Bench (LLM-as-a-judge paper)
The paper that popularised using a strong model as a judge, with multi-turn questions and an analysis of where judges agree with humans and where they are biased.
Writing & instruction followingIFEval
Prompts with instructions a program can check automatically (word counts, formats, keywords), so no judge model is needed.