Multilingual & Indian languages evals
CodingAgents & tool useCustomer supportWriting & instruction followingSafety & factualityHealthcareMultilingual & Indian languagesRAG & retrievalReasoning & knowledgeRubric libraries & frameworks
Multilingual & Indian languages
IndicGenBench
Generation tasks such as summarisation, translation and question answering across many Indian languages, including low-resource ones.
Multilingual & Indian languagesMILU
A knowledge benchmark in Indian languages that includes India-specific subjects, not just translated Western exams.
Multilingual & Indian languagesGlobal-MMLU
MMLU improved and translated into many languages, with labels marking which questions are culturally specific.
Multilingual & Indian languagesSamiksha
A community-built pipeline for evaluating health chatbots in Hindi, Kannada and Malayalam, combining human raters with LLM judges.