Benchmarks
84 benchmark families
Registry benchmarks
| Benchmark | Latest version | Released |
|---|---|---|
| Agent's Last Exam | ALE-V1 — ALE-Claw, 5h (configuration) | September 30, 2026 |
| AI2D | TEST | March 24, 2016 |
| APEX-Agents | Original | January 21, 2026 |
| Arena Text | Text Overall — 2026-09-13 snapshot | September 13, 2026 |
| AutomationBench | 1.0.6 | July 31, 2026 |
| BabyVision | Original | January 13, 2026 |
| BenchCAD | Vision2Code — With tools (configuration) | June 24, 2026 |
| BeyondAIME | Original | June 17, 2025 at 3:37 AM UTC |
| BIG-Bench Extra Hard | Original — micro average | February 26, 2025 |
| BrowseComp | BrowseComp | April 10, 2025 |
| Chartography | October 2026 leaderboard | October 7, 2026 |
| ChartQA | TEST | March 19, 2022 |
| CharXiv | Reasoning — Search and code execution (configuration) | July 21, 2026 |
| CL-bench | Original | February 3, 2026 |
| Codeforces | No tools (configuration) | August 5, 2025 |
| Coronavirus–ACE2 Cell-Entry Screen | Original | September 3, 2026 |
| CursorBench | 4.0 | September 10, 2026 |
| CWE-bench | 1 | September 25, 2026 |
| CyberGym | Original | June 3, 2025 |
| DeepSearchQA | 900-prompt set | December 11, 2025 |
| DeepSWE | 1.1 | June 15, 2026 |
| ERQA | No tools (configuration) | April 8, 2026 |
| Finance Agent Benchmark | 2 — October 2026 evaluation | October 6, 2026 |
| FrontierScience | Research | December 16, 2025 |
| FrontierSWE | 2 — September 2026 evaluation | September 30, 2026 |
| GAIA2 | Public 800 tasks | February 12, 2026 |
| GDP.pdf | GDP.pdf | July 13, 2026 |
| GDPval | GDPval | September 25, 2025 |
| Global MMLU | Original | December 4, 2024 |
| GPQA | Diamond | November 20, 2023 |
| GraphWalks | 256k to 1M — BFS, 200 items | September 30, 2026 |
| HallusionBench | Original | October 23, 2023 |
| HLAB | October 2026 evaluation | October 6, 2026 |
| HealthBench | HealthBench | May 12, 2025 |
| HLE-Verified | Full 1,811-item verified set | February 15, 2026 |
| Humanity's Last Exam | Full set — Scale AI evaluation | April 3, 2025 |
| IFBench | Original | July 3, 2025 |
| IFEval | Original | November 14, 2023 |
| International Physics Olympiad | 2025 Theory | July 21, 2025 |
| JobBench | Main 65 tasks | May 25, 2026 |
| LABBench2 | Terminal and internet — September 2026 evaluation (configuration) | September 30, 2026 |
| LongBench | v2 | December 20, 2024 |
| LVBench | 1024 frames — Agentic | June 12, 2024 |
| MMMU | MMMU | November 27, 2023 |
| MMLU | MMLU | September 7, 2020 |
| MATH-Vision | Original | February 22, 2024 |
| MathVerse | MINI | March 21, 2024 |
| MathVista | MINI | October 3, 2023 |
| MCP Atlas | Public, April 2026 update | April 8, 2026 |
| MedXpertQA | MM | January 30, 2025 |