Versions

1 version · Metric: MMMU Accuracy

Versions of Massive Multi-discipline Multimodal Understanding
VersionReleasedModelsResults
MMMULatestNovember 27, 202399

Recently reported results: MMMU

Latest version: MMMU

Recently reported results for MMMU
ModelScoreSource
Qwen3.6-35B-A3B81.7%alibabacloud.com for Qwen3.6-35B-A3B on Massive Multi-discipline Multimodal Understanding MMMU (opens in a new tab)MMMU AccuracyReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3.6-35B-A3B on Massive Multi-discipline Multimodal Understanding MMMU
Qwen3.5-397B-A17B85.0%alibabacloud.com for Qwen3.5-397B-A17B on Massive Multi-discipline Multimodal Understanding MMMU (opens in a new tab)MMMU AccuracyReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3.5-397B-A17B on Massive Multi-discipline Multimodal Understanding MMMU
Gemini 2.0 Flash69.3%storage.googleapis.com for Gemini 2.0 Flash on Massive Multi-discipline Multimodal Understanding MMMU (opens in a new tab)MMMU AccuracyReported Technical reportGoogleSelf-reportedGoogle DeepMindRecord for Gemini 2.0 Flash on Massive Multi-discipline Multimodal Understanding MMMU
Gemini 2.5 Pro82.0%storage.googleapis.com for Gemini 2.5 Pro on Massive Multi-discipline Multimodal Understanding MMMU (opens in a new tab)MMMU AccuracyReported Technical reportGoogleSelf-reportedGoogle DeepMindRecord for Gemini 2.5 Pro on Massive Multi-discipline Multimodal Understanding MMMU
Gemini 2.5 Flash79.7%storage.googleapis.com for Gemini 2.5 Flash on Massive Multi-discipline Multimodal Understanding MMMU (opens in a new tab)MMMU AccuracyReported Technical reportGoogleSelf-reportedGoogle DeepMindRecord for Gemini 2.5 Flash on Massive Multi-discipline Multimodal Understanding MMMU