MMMU-Pro
MMMU-Pro results reported for 64 models across 5 versions. Updated 2026-10-07.
Report an issueVersions
5 versions · Metric: MMMU-Pro accuracy
| Version | Released | Models | Results |
|---|---|---|---|
| MMMU-Pro With toolsConfiguration: With tools | March 5, 2026 | 6 | 6 |
| MMMU-Pro With PythonConfiguration: With Python | December 11, 2025 | 3 | 3 |
| MMMU-Pro 1,730 questions — Mercor single-shotConfiguration: Mercor single-shot agent | September 4, 2024 | 32 | 34 |
| MMMU-Pro No toolsConfiguration: No tools | September 4, 2024 | 17 | 18 |
| MMMU-Pro Vals AI harnessConfiguration: Vals AI harness | September 4, 2024 | 55 | 60 |
Settings
Each score is labelled with the setting its source states.
Recently reported results: MMMU-Pro With tools
Most recent configuration: MMMU-Pro With tools