Results

124 results

Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness results
ProviderModelScoreSourceRegistry No.
OpenAIGPT-4.5 Preview68.7%epoch.ai for GPT-4.5 Preview on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-4.5 Preview on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10001
OpenAIGPT-4.166.9%epoch.ai for GPT-4.1 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-4.1 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10002
OpenAIOpenAI o3 (low)79.8%epoch.ai for OpenAI o3 (low) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for OpenAI o3 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10003
OpenAIOpenAI o3 (high)81.8%epoch.ai for OpenAI o3 (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for OpenAI o3 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10003
OpenAIOpenAI o3 (medium)80.8%epoch.ai for OpenAI o3 (medium) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for OpenAI o3 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10003
OpenAIOpenAI o4-mini (medium)77.8%epoch.ai for OpenAI o4-mini (medium) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for OpenAI o4-mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10004
OpenAIOpenAI o4-mini (high)79.6%epoch.ai for OpenAI o4-mini (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for OpenAI o4-mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10004
OpenAIOpenAI o4-mini (low)75.3%epoch.ai for OpenAI o4-mini (low) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for OpenAI o4-mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10004
OpenAIGPT-6 Astra (max)95.8%epoch.ai for GPT-6 Astra (max) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-6 Astra on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10005
OpenAIGPT-5.4 (medium)88.9%epoch.ai for GPT-5.4 (medium) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.4 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10007
OpenAIGPT-5.4 (none)74.7%epoch.ai for GPT-5.4 (none) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.4 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10007
OpenAIGPT-5.4 (high)89.9%epoch.ai for GPT-5.4 (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.4 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10007
OpenAIGPT-5.4 (low)84.8%epoch.ai for GPT-5.4 (low) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.4 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10007
OpenAIGPT-5.4 (xhigh)93.3%epoch.ai for GPT-5.4 (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.4 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10007
OpenAIGPT-5.5 (none)77.3%epoch.ai for GPT-5.5 (none) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10008
OpenAIGPT-5.5 (low)90.7%epoch.ai for GPT-5.5 (low) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10008
OpenAIGPT-5.6 Luna (max)91.6%epoch.ai for GPT-5.6 Luna (max) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.6 Luna on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10009
OpenAIGPT-5.6 Luna (low)82.3%epoch.ai for GPT-5.6 Luna (low) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.6 Luna on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10009
OpenAIGPT-5.6 Luna (none)63.6%epoch.ai for GPT-5.6 Luna (none) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.6 Luna on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10009
OpenAIGPT-5.6 Sol (low)89.9%epoch.ai for GPT-5.6 Sol (low) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.6 Sol on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10010
OpenAIGPT-5.6 Sol (max)93.5%epoch.ai for GPT-5.6 Sol (max) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.6 Sol on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10010
OpenAIGPT-5.6 Sol (none)82.8%epoch.ai for GPT-5.6 Sol (none) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.6 Sol on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10010
OpenAIGPT-5.6 Terra (none)77.3%epoch.ai for GPT-5.6 Terra (none) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.6 Terra on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10011
OpenAIGPT-5.6 Terra (low)87.4%epoch.ai for GPT-5.6 Terra (low) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.6 Terra on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10011
OpenAIGPT-5.6 Terra (max)93.3%epoch.ai for GPT-5.6 Terra (max) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.6 Terra on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10011
OpenAIGPT-5.2 (high)88.2%epoch.ai for GPT-5.2 (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.2 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10012
OpenAIGPT-5.2 (low)82.7%epoch.ai for GPT-5.2 (low) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.2 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10012
OpenAIGPT-5.2 (medium)87.9%epoch.ai for GPT-5.2 (medium) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.2 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10012
OpenAIGPT-5.2 (none)73.2%epoch.ai for GPT-5.2 (none) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.2 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10012
OpenAIGPT-5.2 (xhigh)91.4%epoch.ai for GPT-5.2 (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.2 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10012
OpenAIGPT-6 Luna (max)90.5%epoch.ai for GPT-6 Luna (max) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-6 Luna on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10013
OpenAIGPT-6 Sol (max)94.3%epoch.ai for GPT-6 Sol (max) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-6 Sol on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10014
OpenAIGPT-6.1 Sol (max)95.4%epoch.ai for GPT-6.1 Sol (max) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-6.1 Sol on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10015
OpenAIGPT-4.1 mini65.8%epoch.ai for GPT-4.1 mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-4.1 mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10016
OpenAIGPT-4.1 nano48.9%epoch.ai for GPT-4.1 nano on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-4.1 nano on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10017
OpenAIGPT-5 (high)86.2%epoch.ai for GPT-5 (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10018
OpenAIGPT-5 (medium)85.4%epoch.ai for GPT-5 (medium) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10018
OpenAIGPT-5 mini (medium)71.7%epoch.ai for GPT-5 mini (medium) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5 mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10019
OpenAIGPT-5 mini (high)75.0%epoch.ai for GPT-5 mini (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5 mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10019
OpenAIGPT-5 nano (low)57.6%epoch.ai for GPT-5 nano (low) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5 nano on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10020
OpenAIGPT-5 nano (medium)67.4%epoch.ai for GPT-5 nano (medium) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5 nano on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10020
OpenAIGPT-5 nano (high)69.4%epoch.ai for GPT-5 nano (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5 nano on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10020
OpenAIGPT-5.4 mini (xhigh)86.9%epoch.ai for GPT-5.4 mini (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.4 mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10021
OpenAIGPT-5.4 mini (none)64.1%epoch.ai for GPT-5.4 mini (none) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.4 mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10021
OpenAIGPT-5.4 mini (high)83.6%epoch.ai for GPT-5.4 mini (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.4 mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10021
OpenAIGPT-5.4 nano (low)72.2%epoch.ai for GPT-5.4 nano (low) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.4 nano on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10022
OpenAIGPT-5.4 nano (none)55.6%epoch.ai for GPT-5.4 nano (none) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.4 nano on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10022
OpenAIGPT-5.4 nano (high)78.5%epoch.ai for GPT-5.4 nano (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.4 nano on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness10022
DeepSeek AIDeepSeek-V4-Pro (max)89.6%epoch.ai for DeepSeek-V4-Pro (max) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for DeepSeek-V4-Pro on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness110002
DeepSeek AIDeepSeek-V4-Pro (none)73.2%epoch.ai for DeepSeek-V4-Pro (none) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for DeepSeek-V4-Pro on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness110002