Results

24 results

MMLU-Pro Original results
ProviderModelScoreSourceRegistry No.
Microsoft AIMAI-Thinking-185.0%microsoft.ai for MAI-Thinking-1 on MMLU-Pro Original (opens in a new tab)AccuracyReported Technical reportMicrosoft AISelf-reportedMicrosoftRecord for MAI-Thinking-1 on MMLU-Pro Original70003
Google (DeepMind)Gemma 4 26B A4B Instruct (thinking mode)82.6%huggingface.co for Gemma 4 26B A4B Instruct (thinking mode) on MMLU-Pro Original (opens in a new tab)AccuracyReported Model cardGoogleSelf-reportedGoogle DeepMindRecord for Gemma 4 26B A4B Instruct on MMLU-Pro Original35001
Google (DeepMind)Gemma 4 31B Instruct (thinking mode)85.2%huggingface.co for Gemma 4 31B Instruct (thinking mode) on MMLU-Pro Original (opens in a new tab)AccuracyReported Model cardGoogleSelf-reportedGoogle DeepMindRecord for Gemma 4 31B Instruct on MMLU-Pro Original35002
Google (DeepMind)Gemma 4 E2B Instruct (thinking mode)60.0%huggingface.co for Gemma 4 E2B Instruct (thinking mode) on MMLU-Pro Original (opens in a new tab)AccuracyReported Model cardGoogleSelf-reportedGoogle DeepMindRecord for Gemma 4 E2B Instruct on MMLU-Pro Original35003
Google (DeepMind)Gemma 4 E4B Instruct (thinking mode)69.4%huggingface.co for Gemma 4 E4B Instruct (thinking mode) on MMLU-Pro Original (opens in a new tab)AccuracyReported Model cardGoogleSelf-reportedGoogle DeepMindRecord for Gemma 4 E4B Instruct on MMLU-Pro Original35004
Google (DeepMind)Gemma 4 12B Instruct (thinking mode)77.2%huggingface.co for Gemma 4 12B Instruct (thinking mode) on MMLU-Pro Original (opens in a new tab)AccuracyReported Model cardGoogleSelf-reportedGoogle DeepMindRecord for Gemma 4 12B Instruct on MMLU-Pro Original35005
Alibaba (Tongyi)Qwen3.7-Plus88.5%alibabacloud.com for Qwen3.7-Plus on MMLU-Pro Original (opens in a new tab)AccuracyReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3.7-Plus on MMLU-Pro Original130007
Alibaba (Tongyi)Qwen3.7-Max89.6%qwen.ai for Qwen3.7-Max on MMLU-Pro Original (opens in a new tab)AccuracyReported Launch postQwen TeamSelf-reportedRecord for Qwen3.7-Max on MMLU-Pro Original130006
DeepSeek AIDeepSeek-V4-Flash (non-thinking)83.0%huggingface.co for DeepSeek-V4-Flash (non-thinking) on MMLU-Pro Original (opens in a new tab)AccuracyReported Model cardDeepSeekSelf-reportedDeepSeek AIRecord for DeepSeek-V4-Flash on MMLU-Pro Original110001
DeepSeek AIDeepSeek-V4-Flash (max)86.2%huggingface.co for DeepSeek-V4-Flash (max) on MMLU-Pro Original (opens in a new tab)AccuracyReported Model cardDeepSeekSelf-reportedDeepSeek AIRecord for DeepSeek-V4-Flash on MMLU-Pro Original110001
DeepSeek AIDeepSeek-V4-Flash (high)86.4%huggingface.co for DeepSeek-V4-Flash (high) on MMLU-Pro Original (opens in a new tab)AccuracyReported Model cardDeepSeekSelf-reportedDeepSeek AIRecord for DeepSeek-V4-Flash on MMLU-Pro Original110001
DeepSeek AIDeepSeek-V4-Pro (max)87.5%huggingface.co for DeepSeek-V4-Pro (max) on MMLU-Pro Original (opens in a new tab)AccuracyReported Model cardDeepSeekSelf-reportedDeepSeek AIRecord for DeepSeek-V4-Pro on MMLU-Pro Original110002
DeepSeek AIDeepSeek-V4-Pro (high)87.1%huggingface.co for DeepSeek-V4-Pro (high) on MMLU-Pro Original (opens in a new tab)AccuracyReported Model cardDeepSeekSelf-reportedDeepSeek AIRecord for DeepSeek-V4-Pro on MMLU-Pro Original110002
DeepSeek AIDeepSeek-V4-Pro (non-thinking)82.9%huggingface.co for DeepSeek-V4-Pro (non-thinking) on MMLU-Pro Original (opens in a new tab)AccuracyReported Model cardDeepSeekSelf-reportedDeepSeek AIRecord for DeepSeek-V4-Pro on MMLU-Pro Original110002
Alibaba (Tongyi)Qwen3.6-35B-A3B85.2%alibabacloud.com for Qwen3.6-35B-A3B on MMLU-Pro Original (opens in a new tab)AccuracyReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3.6-35B-A3B on MMLU-Pro Original130005
Alibaba (Tongyi)Qwen3.6-Plus88.5%alibabacloud.com for Qwen3.6-Plus on MMLU-Pro Original (opens in a new tab)AccuracyReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3.6-Plus on MMLU-Pro Original130004
Mistral AIMistral Small 4 (high)78.0%huggingface.co for Mistral Small 4 (high) on MMLU-Pro Original (opens in a new tab)AccuracyReported Model cardMistral AISelf-reportedRecord for Mistral Small 4 on MMLU-Pro Original90004
Mistral AIMistral Small 4 (none)73.5%huggingface.co for Mistral Small 4 (none) on MMLU-Pro Original (opens in a new tab)AccuracyReported Model cardMistral AISelf-reportedRecord for Mistral Small 4 on MMLU-Pro Original90004
NVIDIANVIDIA Nemotron 3 Super 120B-A12B83.7%huggingface.co for NVIDIA Nemotron 3 Super 120B-A12B on MMLU-Pro Original (opens in a new tab)AccuracyReported Model cardNVIDIASelf-reportedRecord for NVIDIA Nemotron 3 Super 120B-A12B on MMLU-Pro Original60002
Alibaba (Tongyi)Qwen3.5-397B-A17B87.8%alibabacloud.com for Qwen3.5-397B-A17B on MMLU-Pro Original (opens in a new tab)AccuracyReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3.5-397B-A17B on MMLU-Pro Original130003
Moonshot AIKimi K2.5 (thinking)87.1%huggingface.co for Kimi K2.5 (thinking) on MMLU-Pro Original (opens in a new tab)AccuracyReported Model cardMoonshot AISelf-reportedRecord for Kimi K2.5 on MMLU-Pro Original120001
Alibaba (Tongyi)Qwen3-Max-Thinking85.7%alibabacloud.com for Qwen3-Max-Thinking on MMLU-Pro Original (opens in a new tab)AccuracyReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3-Max-Thinking on MMLU-Pro Original130002
Z.aiGLM-4.784.3%z.ai for GLM-4.7 on MMLU-Pro Original (opens in a new tab)AccuracyReported Launch postZ.aiSelf-reportedRecord for GLM-4.7 on MMLU-Pro Original150001
NVIDIANVIDIA Nemotron 3 Nano 30B-A3B78.3%huggingface.co for NVIDIA Nemotron 3 Nano 30B-A3B on MMLU-Pro Original (opens in a new tab)AccuracyReported Model cardNVIDIASelf-reportedRecord for NVIDIA Nemotron 3 Nano 30B-A3B on MMLU-Pro Original60001