Rubric libraries & frameworks evals
CodingAgents & tool useCustomer supportWriting & instruction followingSafety & factualityHealthcareMultilingual & Indian languagesRAG & retrievalReasoning & knowledgeRubric libraries & frameworks
Rubric libraries & frameworks
Inspect Evals
A large, actively maintained collection of ready-to-run evals implemented in the Inspect framework.
Rubric libraries & frameworksOpenAI Evals
A framework and open registry of evals, including templates for model-graded evaluation.
Rubric libraries & frameworksLLMJury rubric library
Paste-ready judge rubrics for questions like 'did the support reply resolve the request?', each with score meanings, examples and known failure modes. Made by a vendor.
Rubric libraries & frameworksPrompt Assay judge templates
Copy-paste YAML judge templates covering basics like relevance and tone plus RAG, code, summarisation and agent traces. Made by a vendor.