Results

18 results

MMMU-Pro No tools results
ProviderModelScoreSourceRegistry No.
Moonshot AIKimi K3 (max)81.6%huggingface.co for Kimi K3 (max) on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Model cardMoonshot AISelf-reportedRecord for Kimi K3 on MMMU-Pro No tools120003
OpenAIGPT-5.6 Luna78.4%openai.com for GPT-5.6 Luna on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on MMMU-Pro No tools10009
OpenAIGPT-5.6 Sol83.0%openai.com for GPT-5.6 Sol on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on MMMU-Pro No tools10010
OpenAIGPT-5.6 Terra80.7%openai.com for GPT-5.6 Terra on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Terra on MMMU-Pro No tools10011
Google (DeepMind)Gemini 3.5 Flash83.6%deepmind.google for Gemini 3.5 Flash on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Overall (Standard 10 options + Vision)Reported Model cardGoogle DeepMindSelf-reportedRecord for Gemini 3.5 Flash on MMMU-Pro No tools30006
OpenAIGPT-5.5 (xhigh)81.2%openai.com for GPT-5.5 (xhigh) on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Launch postOpenAISelf-reportedRecord for GPT-5.5 on MMMU-Pro No tools10008
Moonshot AIKimi K2.6 (thinking)79.4%huggingface.co for Kimi K2.6 (thinking) on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Model cardMoonshot AISelf-reportedRecord for Kimi K2.6 on MMMU-Pro No tools120002
Alibaba (Tongyi)Qwen3.6-35B-A3B75.3%huggingface.co for Qwen3.6-35B-A3B on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Model cardQwenSelf-reportedQwen TeamRecord for Qwen3.6-35B-A3B on MMMU-Pro No tools130005
Meta AI (originally Facebook AI Research)Muse Spark (thinking)80.4%ai.meta.com for Muse Spark (thinking) on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Standard (10 options)Reported Evaluation methodologyMetaSelf-reportedRecord for Muse Spark on MMMU-Pro No tools80001
Mistral AIMistral Small 4 (high)60.0%huggingface.co for Mistral Small 4 (high) on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Model cardMistral AISelf-reportedRecord for Mistral Small 4 on MMMU-Pro No tools90004
Mistral AIMistral Small 4 (none)46.3%huggingface.co for Mistral Small 4 (none) on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Model cardMistral AISelf-reportedRecord for Mistral Small 4 on MMMU-Pro No tools90004
OpenAIGPT-5.4 (xhigh)81.2%openai.com for GPT-5.4 (xhigh) on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Launch postOpenAISelf-reportedRecord for GPT-5.4 on MMMU-Pro No tools10007
Google (DeepMind)Gemini 3.1 Pro (High)80.5%deepmind.google for Gemini 3.1 Pro (High) on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Overall (Standard 10 options + Vision)Reported Model cardGoogle DeepMindSelf-reportedRecord for Gemini 3.1 Pro on MMMU-Pro No tools30005
AnthropicClaude Sonnet 4.6 (adaptive thinking, max)74.5%www-cdn.anthropic.com for Claude Sonnet 4.6 (adaptive thinking, max) on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Overall (Standard 10 options + Vision)Reported System cardAnthropicSelf-reportedRecord for Claude Sonnet 4.6 on MMMU-Pro No tools20009
Moonshot AIKimi K2.5 (thinking)78.5%huggingface.co for Kimi K2.5 (thinking) on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Model cardMoonshot AISelf-reportedRecord for Kimi K2.5 on MMMU-Pro No tools120001
Google (DeepMind)Gemini 3 Flash81.2%blog.google for Gemini 3 Flash on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Overall (Standard 10 options + Vision)Reported Launch postGoogleSelf-reportedGoogle DeepMindRecord for Gemini 3 Flash on MMMU-Pro No tools30009
OpenAIGPT-5.2 (xhigh)79.5%openai.com for GPT-5.2 (xhigh) on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Launch postOpenAISelf-reportedRecord for GPT-5.2 on MMMU-Pro No tools10012
Google (DeepMind)Gemini 3 Pro (high)81.0%blog.google for Gemini 3 Pro (high) on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Overall (Standard 10 options + Vision)Reported Launch postGoogleSelf-reportedGoogle DeepMindRecord for Gemini 3 Pro on MMMU-Pro No tools30008