Healthcare

MedMCQA

by Pal, Umapathi & Sankarasubbu

What is MedMCQA? MedMCQA is a healthcare eval made by Pal, Umapathi & Sankarasubbu. More than 194k multiple-choice questions from India's AIIMS and NEET PG medical entrance exams, spanning 21 subjects and about 2.4k topics, with explanations. Good for broad medical knowledge checks, though exam questions say little about real patient conversations.

Page last updated 2026-10-18 · Evals Review

Editor note

More than 194k multiple-choice questions from India's AIIMS and NEET PG medical entrance exams, spanning 21 subjects and about 2.4k topics, with explanations. Good for broad medical knowledge checks, though exam questions say little about real patient conversations.

What it tests
Medical entrance-exam knowledge across many subjects.
Original source
github.com/medmcqa/medmcqa
Last updated
Repo last commit 2022-11-28
License
MIT

Facts come only from the linked source (checked 15–16 Oct 2026). Credit belongs to the creators. We don't score or rank evals: how we review.

Reviews

No reviews yet.

Reviews are written by people who sign in with GitHub, one per account per eval. We can't confirm that each reviewer used the eval; we remove reviews that break our rules, never just for being negative, and we never add, buy or edit reviews. Averages, when shown, come only from these reviews.

Reviews from practitioners who sign in with GitHub open soon.

Related healthcare evals

  • HealthBench — Emergency referrals, handling uncertainty, global health, communication quality and more.
  • MedQA — Medical exam knowledge.
  • MedHELM — Broad clinical tasks: documentation, decision support, patient communication and more.
  • KARMA-OpenMedEvalKit — Medical AI in Indian contexts, including speech recognition and record parsing.

All Healthcare evals