GDP.xlsx
by Surge AI (Suhaas Garre, Sushant Mehta, Edwin Chen)
What is GDP.xlsx? GDP.xlsx is an agents & tool use eval made by Surge AI (Suhaas Garre, Sushant Mehta, Edwin Chen). A spreadsheet benchmark for agents: 70 workplace requests written by professionals in 13 domains, each tied to the real workbook or CSV it refers to (2.18 million populated cells in total) and to an expert rubric of 791 binary criteria overall. The agent works in a container with spreadsheet tools, and an agentic judge that can open the file applies the rubric; set-valued answers must be complete with nothing extra. Models are ranked by strict pass@1, meaning every criterion met. Surge AI's paper (arXiv:2611.17766) reports Gemini 4 Argon on top at 38.3% across 20 configurations, with a median of 19.3%. Only the harness and three public tasks are released; the other 67 are held out against contamination.
Editor note
A spreadsheet benchmark for agents: 70 workplace requests written by professionals in 13 domains, each tied to the real workbook or CSV it refers to (2.18 million populated cells in total) and to an expert rubric of 791 binary criteria overall. The agent works in a container with spreadsheet tools, and an agentic judge that can open the file applies the rubric; set-valued answers must be complete with nothing extra. Models are ranked by strict pass@1, meaning every criterion met. Surge AI's paper (arXiv:2611.17766) reports Gemini 4 Argon on top at 38.3% across 20 configurations, with a median of 19.3%. Only the harness and three public tasks are released; the other 67 are held out against contamination.
- What it tests
- Whether an agent reads a professional workbook like a domain expert: cross-tab reconciliation, meaningful formatting and rules stated in the file.
- Original source
- github.com/surge-ai/gdp-xlsx
- Last updated
- arXiv:2611.17766 (Nov 2026); harness repo last push 2026-09-29 (GitHub API, read 17 Nov 2026)
- License
- Apache-2.0 harness (GitHub API, read 17 Nov 2026)
Related agents & tool use evals
- GAIA — General assistant skills: browsing, file handling, multi-step reasoning.
- WebArena — Autonomous web navigation and task completion.
- OSWorld — Computer-use agents operating real operating systems and apps.
- Terminal-Bench — Agents working in the shell end to end.
Discussion
No one has discussed GDP.xlsx yet. Have you run it? Share what it caught, what it missed or how you set it up.