MMMU-Pro
Updated
Cite
Fill in the access date before citing.
Plain text
Benchmark Registry. MMMU-Pro With Python benchmark results. Benchmark identifier: mmmu-pro/with-python. https://benchmarkregistry.org/benchmarks/mmmu-pro/with-python. Accessed [YYYY-MM-DD]. Data license: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Attribution: Benchmark Registry, a project of Densa Labs — https://benchmarkregistry.org/ (CC BY 4.0). Include the cited record URL and identify any changes.
BibTeX
@misc{br_mmmu_pro_with_python,
title = {MMMU-Pro With Python benchmark results},
publisher = {Benchmark Registry},
url = {https://benchmarkregistry.org/benchmarks/mmmu-pro/with-python},
urldate = {YYYY-MM-DD},
note = {Benchmark identifier: mmmu-pro/with-python; data license: CC BY 4.0; access date to be filled by the reader}
}Results
3 results
| Provider | Model | Score | Source | Registry No. |
|---|---|---|---|---|
| Moonshot AI | Kimi K2.6 (thinking) | 80.1% | huggingface.co for Kimi K2.6 (thinking) on MMMU-Pro With Python (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Model cardMoonshot AISelf-reportedRecord for Kimi K2.6 on MMMU-Pro With Python | 120002 |
| Meta AI (originally Facebook AI Research) | Muse Spark (thinking) | 81.3% | ai.meta.com for Muse Spark (thinking) on MMMU-Pro With Python (opens in a new tab)MMMU-Pro accuracySetting: Standard (10 options)Reported Evaluation methodologyMetaSelf-reportedRecord for Muse Spark on MMMU-Pro With Python | 80001 |
| OpenAI | GPT-5.2 (xhigh) | 80.4% | openai.com for GPT-5.2 (xhigh) on MMMU-Pro With Python (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Launch postOpenAISelf-reportedRecord for GPT-5.2 on MMMU-Pro With Python | 10012 |