Results

76 results

Graduate-Level Google-Proof Q&A Diamond — Vals AI harness results
ProviderModelScoreSourceRegistry No.
OpenAIGPT-4.1 (high)65.4%vals.ai for GPT-4.1 (high) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-4.1 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness10002
OpenAIOpenAI o3 (high)84.1%vals.ai for OpenAI o3 (high) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for OpenAI o3 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness10003
OpenAIOpenAI o4-mini (high)74.5%vals.ai for OpenAI o4-mini (high) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for OpenAI o4-mini on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness10004
OpenAIGPT-5.4 (xhigh)91.7%vals.ai for GPT-5.4 (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.4 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness10007
OpenAIGPT-5.5 (xhigh)93.2%vals.ai for GPT-5.5 (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness10008
OpenAIGPT-5.6 Luna (max)91.7%vals.ai for GPT-5.6 Luna (max) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.6 Luna on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness10009
OpenAIGPT-5.6 Sol (max)95.2%vals.ai for GPT-5.6 Sol (max) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.6 Sol on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness10010
OpenAIGPT-5.6 Terra (xhigh)90.9%vals.ai for GPT-5.6 Terra (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.6 Terra on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness10011
OpenAIGPT-5.2 (xhigh)91.7%vals.ai for GPT-5.2 (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.2 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness10012
OpenAIGPT-4.1 mini (high)67.9%vals.ai for GPT-4.1 mini (high) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-4.1 mini on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness10016
OpenAIGPT-4.1 nano (high)50.8%vals.ai for GPT-4.1 nano (high) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-4.1 nano on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness10017
OpenAIGPT-5 (high)85.6%vals.ai for GPT-5 (high) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness10018
OpenAIGPT-5 mini (high)80.3%vals.ai for GPT-5 mini (high) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5 mini on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness10019
OpenAIGPT-5 nano (high)63.4%vals.ai for GPT-5 nano (high) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5 nano on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness10020
OpenAIGPT-5.4 mini (xhigh)83.1%vals.ai for GPT-5.4 mini (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.4 mini on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness10021
OpenAIGPT-5.4 nano (high)77.5%vals.ai for GPT-5.4 nano (high) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.4 nano on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness10022
DeepSeek AIDeepSeek-V4-Pro (max)89.4%vals.ai for DeepSeek-V4-Pro (max) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for DeepSeek-V4-Pro on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness110002
DeepSeek AIDeepSeek-V3.2 (high)80.3%vals.ai for DeepSeek-V3.2 (high) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for DeepSeek-V3.2 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness110003
DeepSeek AIDeepSeek-V3.2 (none)76.3%vals.ai for DeepSeek-V3.2 (none) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for DeepSeek-V3.2 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness110003
Moonshot AIKimi K2.5 (thinking)84.1%vals.ai for Kimi K2.5 (thinking) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Kimi K2.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness120001
Moonshot AIKimi K2.689.1%vals.ai for Kimi K2.6 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Kimi K2.6 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness120002
Moonshot AIKimi K392.9%vals.ai for Kimi K3 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Kimi K3 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness120003
Alibaba (Tongyi)Qwen3-Max-Thinking84.8%vals.ai for Qwen3-Max-Thinking on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Qwen3-Max-Thinking on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness130002
Alibaba (Tongyi)Qwen3.6-Plus87.4%vals.ai for Qwen3.6-Plus on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Qwen3.6-Plus on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness130004
Alibaba (Tongyi)Qwen3.7-Max90.2%vals.ai for Qwen3.7-Max on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Qwen3.7-Max on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness130006
Alibaba (Tongyi)Qwen3.8-Max93.7%vals.ai for Qwen3.8-Max on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Qwen3.8-Max on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness130008
MiniMaxMiniMax M2.582.1%vals.ai for MiniMax M2.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for MiniMax M2.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness140001
MiniMaxMiniMax M2.786.6%vals.ai for MiniMax M2.7 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for MiniMax M2.7 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness140002
MiniMaxMiniMax M392.7%vals.ai for MiniMax M3 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for MiniMax M3 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness140003
Z.aiGLM-4.780.1%vals.ai for GLM-4.7 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-4.7 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness150001
Z.aiGLM-5 (thinking)83.3%vals.ai for GLM-5 (thinking) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness150002
Z.aiGLM-5.184.5%vals.ai for GLM-5.1 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-5.1 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness150003
Z.aiGLM-5.285.6%vals.ai for GLM-5.2 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-5.2 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness150004
Z.aiGLM-5.3 (max)88.1%vals.ai for GLM-5.3 (max) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-5.3 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness150005
Z.aiGLM-5.3-Flash (max)86.4%vals.ai for GLM-5.3-Flash (max) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-5.3-Flash on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness150006
Z.aiGLM-4.572.2%vals.ai for GLM-4.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-4.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness150007
Z.aiGLM-4.674.5%vals.ai for GLM-4.6 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-4.6 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness150009
OpenAIgpt-oss-120b78.5%vals.ai for gpt-oss-120b on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for gpt-oss-120b on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness15001
Thinking Machines LabInkling (0.99)87.1%vals.ai for Inkling (0.99) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Inkling on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness160001
Thinking Machines LabInkling-Small (0.99)83.6%vals.ai for Inkling-Small (0.99) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Inkling-Small on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness160002
AnthropicClaude 3.7 Sonnet67.4%vals.ai for Claude 3.7 Sonnet on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude 3.7 Sonnet on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness20001
AnthropicClaude 3.7 Sonnet (thinking)75.3%vals.ai for Claude 3.7 Sonnet (thinking) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude 3.7 Sonnet on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness20001
AnthropicClaude Opus 471.7%vals.ai for Claude Opus 4 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness20002
AnthropicClaude Sonnet 4 (thinking)75.0%vals.ai for Claude Sonnet 4 (thinking) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 4 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness20003
AnthropicClaude Sonnet 469.4%vals.ai for Claude Sonnet 4 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 4 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness20003
AnthropicClaude Fable 5.193.4%vals.ai for Claude Fable 5.1 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Fable 5.1 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness20004
AnthropicClaude Sonnet 4.5 (thinking)81.6%vals.ai for Claude Sonnet 4.5 (thinking) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 4.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness20005
AnthropicClaude Haiku 4.5 (thinking)72.2%vals.ai for Claude Haiku 4.5 (thinking) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Haiku 4.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness20006
AnthropicClaude Opus 4.5 (thinking)85.9%vals.ai for Claude Opus 4.5 (thinking) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness20007
AnthropicClaude Opus 4.579.5%vals.ai for Claude Opus 4.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness20007