Results

39 results

Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot results
ProviderModelScoreSourceRegistry No.
OpenAIGPT-6 Astra (xhigh)96.2%mercor.com for GPT-6 Astra (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-6 Astra on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot10005
OpenAIGPT-5.4 (xhigh)93.2%mercor.com for GPT-5.4 (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-5.4 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot10007
OpenAIGPT-5.5 (xhigh)94.6%mercor.com for GPT-5.5 (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-5.5 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot10008
OpenAIGPT-5.6 Luna (max)91.8%mercor.com for GPT-5.6 Luna (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-5.6 Luna on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot10009
OpenAIGPT-5.6 Terra (max)93.2%mercor.com for GPT-5.6 Terra (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-5.6 Terra on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot10011
OpenAIGPT-6 Luna (max)89.9%mercor.com for GPT-6 Luna (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-6 Luna on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot10013
OpenAIGPT-6 Sol (max)94.4%mercor.com for GPT-6 Sol (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-6 Sol on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot10014
OpenAIGPT-6.1 Sol (max)95.1%mercor.com for GPT-6.1 Sol (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-6.1 Sol on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot10015
DeepSeek AIDeepSeek-V4-Pro (max)89.4%mercor.com for DeepSeek-V4-Pro (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for DeepSeek-V4-Pro on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot110002
DeepSeek AIDeepSeek-V3.285.2%mercor.com for DeepSeek-V3.2 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for DeepSeek-V3.2 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot110003
Moonshot AIKimi K3 (max)92.7%mercor.com for Kimi K3 (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot120003
Alibaba (Tongyi)Qwen3.8-Max (xhigh)92.5%mercor.com for Qwen3.8-Max (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Qwen3.8-Max on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot130008
MiniMaxMiniMax M2.7 (high)86.0%mercor.com for MiniMax M2.7 (high) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for MiniMax M2.7 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot140002
MiniMaxMiniMax M3 (high)90.5%mercor.com for MiniMax M3 (high) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for MiniMax M3 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot140003
Z.aiGLM-5.2 (max)90.2%mercor.com for GLM-5.2 (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for GLM-5.2 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot150004
Z.aiGLM-5.3 (max)91.3%mercor.com for GLM-5.3 (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for GLM-5.3 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot150005
OpenAIgpt-oss-120b (high)77.5%mercor.com for gpt-oss-120b (high) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for gpt-oss-120b on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot15001
Thinking Machines LabInkling (high)87.2%mercor.com for Inkling (high) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Inkling on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot160001
AnthropicClaude Fable 5.1 (max)91.4%mercor.com for Claude Fable 5.1 (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5.1 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot20004
AnthropicClaude Fable 5.1 (high)85.2%mercor.com for Claude Fable 5.1 (high) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5.1 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot20004
AnthropicClaude Sonnet 4.6 (high)84.7%mercor.com for Claude Sonnet 4.6 (high) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 4.6 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot20009
AnthropicClaude Opus 4.7 (max)86.4%mercor.com for Claude Opus 4.7 (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Opus 4.7 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot20010
AnthropicClaude Opus 4.8 (max)92.0%mercor.com for Claude Opus 4.8 (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Opus 4.8 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot20011
AnthropicClaude Fable 5 (max)85.0%mercor.com for Claude Fable 5 (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot20012
AnthropicClaude Sonnet 5 (max)80.6%mercor.com for Claude Sonnet 5 (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot20013
AnthropicClaude Opus 5 (max)93.6%mercor.com for Claude Opus 5 (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Opus 5 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot20014
AnthropicClaude Opus 5.5 (max)91.3%mercor.com for Claude Opus 5.5 (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Opus 5.5 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot20015
AnthropicClaude Sonnet 5.5 (max)95.2%mercor.com for Claude Sonnet 5.5 (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5.5 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot20016
Google (DeepMind)Gemini 3.8 Flash (high)93.9%mercor.com for Gemini 3.8 Flash (high) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.8 Flash on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot30004
Google (DeepMind)Gemini 3.1 Pro (high)94.2%mercor.com for Gemini 3.1 Pro (high) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.1 Pro on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot30005
Google (DeepMind)Gemini 3.5 Flash (high)85.7%mercor.com for Gemini 3.5 Flash (high) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.5 Flash on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot30006
Google (DeepMind)Gemini 3.6 Flash (high)93.4%mercor.com for Gemini 3.6 Flash (high) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.6 Flash on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot30007
Google (DeepMind)Gemini 3.7 Flash (high)94.2%mercor.com for Gemini 3.7 Flash (high) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.7 Flash on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot30010
Google (DeepMind)Gemma 4 31B Instruct85.5%mercor.com for Gemma 4 31B Instruct on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Gemma 4 31B Instruct on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot35002
SpaceXAIGrok 4.5 (high)92.4%mercor.com for Grok 4.5 (high) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot40001
SpaceXAIGrok 4.6 (xhigh)93.8%mercor.com for Grok 4.6 (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.6 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot40002
NVIDIANVIDIA Nemotron 3 Ultra 550B-A55B (high)87.8%mercor.com for NVIDIA Nemotron 3 Ultra 550B-A55B (high) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for NVIDIA Nemotron 3 Ultra 550B-A55B on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot60003
Meta AI (originally Facebook AI Research)Muse Spark 1.1 (xhigh)90.8%mercor.com for Muse Spark 1.1 (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Muse Spark 1.1 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot80002
Meta AI (originally Facebook AI Research)Muse Spark 1.3 (max)91.3%mercor.com for Muse Spark 1.3 (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Muse Spark 1.3 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot80005