Agents & tool use evals
GAIA
Questions that are easy for a person with a browser and tools but hard for AI assistants, each with one short, checkable answer.
Agents & tool useWebArena
Self-hosted copies of realistic websites (shop, forum, code host and more) where an agent must complete tasks by clicking and typing.
Agents & tool useOSWorld
Puts an agent in a real computer environment and asks it to do tasks across desktop apps, checked by scripts.
Agents & tool useTerminal-Bench
Tasks an agent must finish inside a command-line terminal, such as setting up, debugging or building software.
Agents & tool useBrowseComp
1,266 very hard-to-find facts with short answers that are easy to verify, built to test persistent web-browsing agents.
Agents & tool useMLE-bench
75 real Kaggle machine-learning competitions where an agent must prepare data, train models and submit results, scored against human leaderboard medal thresholds.
Agents & tool useBerkeley Function Calling Leaderboard (BFCL)
Measures how accurately a model calls tools and functions, including parallel calls, multi-turn tool use and agentic scenarios, with an actively updated public leaderboard.