| GPT-4.5 Preview | GPQA Diamond — Epoch AI harness | 68.7% | epoch.ai for GPT-4.5 Preview on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-4.5 Preview on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness | 10001 |
| GPT-4.5 Preview | Humanity's Last Exam Text only — Scale AI evaluation | 5.8% | labs.scale.com for GPT-4.5 Preview on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for GPT-4.5 Preview on Humanity's Last Exam Text only — Scale AI evaluation | 10001 |
| GPT-4.1 | Humanity's Last Exam Text only — Scale AI evaluation | 5.0% | labs.scale.com for GPT-4.1 on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for GPT-4.1 on Humanity's Last Exam Text only — Scale AI evaluation | 10002 |
| GPT-4.1 | SimpleQA Verified Original — Epoch AI harness | 31.1% | epoch.ai for GPT-4.1 on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-4.1 on SimpleQA Verified Original — Epoch AI harness | 10002 |
| GPT-4.1 | GPQA Diamond — Epoch AI harness | 66.9% | epoch.ai for GPT-4.1 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-4.1 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness | 10002 |
| GPT-4.1 | SWE-bench Verified — Epoch AI harness | 48.5% | epoch.ai for GPT-4.1 on SWE-bench Verified — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-4.1 on SWE-bench Verified — Epoch AI harness | 10002 |
| OpenAI o3 (low) | GPQA Diamond — Epoch AI harness | 79.8% | epoch.ai for OpenAI o3 (low) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for OpenAI o3 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness | 10003 |
| OpenAI o3 (high) | Humanity's Last Exam Text only — Scale AI evaluation | 20.6% | labs.scale.com for OpenAI o3 (high) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for OpenAI o3 on Humanity's Last Exam Text only — Scale AI evaluation | 10003 |
| OpenAI o3 (high) | SimpleQA Verified Original — Epoch AI harness | 49.4% | epoch.ai for OpenAI o3 (high) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for OpenAI o3 on SimpleQA Verified Original — Epoch AI harness | 10003 |
| OpenAI o3 (medium) | Humanity's Last Exam Text only — Scale AI evaluation | 19.8% | labs.scale.com for OpenAI o3 (medium) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for OpenAI o3 on Humanity's Last Exam Text only — Scale AI evaluation | 10003 |
| OpenAI o3 (high) | GPQA Diamond — Epoch AI harness | 81.8% | epoch.ai for OpenAI o3 (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for OpenAI o3 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness | 10003 |
| OpenAI o3 (medium) | GPQA Diamond — Epoch AI harness | 80.8% | epoch.ai for OpenAI o3 (medium) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for OpenAI o3 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness | 10003 |
| OpenAI o3 (medium) | SWE-bench Verified — Epoch AI harness | 62.3% | epoch.ai for OpenAI o3 (medium) on SWE-bench Verified — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for OpenAI o3 on SWE-bench Verified — Epoch AI harness | 10003 |
| OpenAI o4-mini (high) | Humanity's Last Exam Text only — Scale AI evaluation | 18.9% | labs.scale.com for OpenAI o4-mini (high) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for OpenAI o4-mini on Humanity's Last Exam Text only — Scale AI evaluation | 10004 |
| OpenAI o4-mini (medium) | GPQA Diamond — Epoch AI harness | 77.8% | epoch.ai for OpenAI o4-mini (medium) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for OpenAI o4-mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness | 10004 |
| OpenAI o4-mini (high) | SimpleQA Verified Original — Epoch AI harness | 18.8% | epoch.ai for OpenAI o4-mini (high) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for OpenAI o4-mini on SimpleQA Verified Original — Epoch AI harness | 10004 |
| OpenAI o4-mini (high) | GPQA Diamond — Epoch AI harness | 79.6% | epoch.ai for OpenAI o4-mini (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for OpenAI o4-mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness | 10004 |
| OpenAI o4-mini (low) | SimpleQA Verified Original — Epoch AI harness | 19.6% | epoch.ai for OpenAI o4-mini (low) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for OpenAI o4-mini on SimpleQA Verified Original — Epoch AI harness | 10004 |
| OpenAI o4-mini (low) | GPQA Diamond — Epoch AI harness | 75.3% | epoch.ai for OpenAI o4-mini (low) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for OpenAI o4-mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness | 10004 |
| OpenAI o4-mini (medium) | Humanity's Last Exam Text only — Scale AI evaluation | 14.5% | labs.scale.com for OpenAI o4-mini (medium) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for OpenAI o4-mini on Humanity's Last Exam Text only — Scale AI evaluation | 10004 |
| GPT-6 Astra (xhigh) | BrowseComp 130-question subset — Mercor web research agent | 94.2% | mercor.com for GPT-6 Astra (xhigh) on BrowseComp 130-question subset — Mercor web research agent (opens in a new tab)Archived copy (opens in a new tab)BrowseComp AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-6 Astra on BrowseComp 130-question subset — Mercor web research agent | 10005 |
| GPT-6 Astra (xhigh) | MMLU-Pro Original — Mercor single-shot | 91.0% | mercor.com for GPT-6 Astra (xhigh) on MMLU-Pro Original — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-6 Astra on MMLU-Pro Original — Mercor single-shot | 10005 |
| GPT-6 Astra (none) | AutomationBench 1.0.6 | 25.3% | zapier.com for GPT-6 Astra (none) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-6 Astra on AutomationBench 1.0.6 | 10005 |
| GPT-6 Astra (max) | MMMU-Pro 1,730 questions — Mercor single-shot | 87.5% | mercor.com for GPT-6 Astra (max) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Benchmark leaderboardMercorIndependentRecord for GPT-6 Astra on MMMU-Pro 1,730 questions — Mercor single-shot | 10005 |
| GPT-6 Astra (xhigh) | GPQA Diamond — Mercor single-shot | 96.2% | mercor.com for GPT-6 Astra (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-6 Astra on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot | 10005 |
| GPT-6 Astra (xhigh) | SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps | 48.9% | mercor.com for GPT-6 Astra (xhigh) on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardMercorIndependentRecord for GPT-6 Astra on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps | 10005 |
| GPT-6 Astra (xhigh) | CharXiv Descriptive and reasoning — Mercor single-shot | 95.8% | mercor.com for GPT-6 Astra (xhigh) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)CharXiv AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-6 Astra on CharXiv Descriptive and reasoning — Mercor single-shot | 10005 |
| GPT-6 Astra | Humanity's Last Exam Text only — Scale AI evaluation | 54.2% | labs.scale.com for GPT-6 Astra on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for GPT-6 Astra on Humanity's Last Exam Text only — Scale AI evaluation | 10005 |
| GPT-6 Astra (Max) | Riemann-bench October 2026 leaderboard | 72.0% | surgehq.ai for GPT-6 Astra (Max) on Riemann-bench October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Riemann-bench Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for GPT-6 Astra on Riemann-bench October 2026 leaderboard | 10005 |
| GPT-6 Astra (max) | DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps | 72.0% | mercor.com for GPT-6 Astra (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for GPT-6 Astra on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps | 10005 |
| GPT-6 Astra (xhigh) | MMMU-Pro 1,730 questions — Mercor single-shot | 86.8% | mercor.com for GPT-6 Astra (xhigh) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Benchmark leaderboardMercorIndependentRecord for GPT-6 Astra on MMMU-Pro 1,730 questions — Mercor single-shot | 10005 |
| GPT-6 Astra (xhigh) | Humanity's Last Exam Text only — Mercor single-shot | 55.6% | mercor.com for GPT-6 Astra (xhigh) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-6 Astra on Humanity's Last Exam Text only — Mercor single-shot | 10005 |
| GPT-6 Astra (max) | CharXiv Descriptive and reasoning — Mercor single-shot | 96.1% | mercor.com for GPT-6 Astra (max) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)CharXiv AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-6 Astra on CharXiv Descriptive and reasoning — Mercor single-shot | 10005 |
| GPT-6 Astra | FrontierSWE 2 — October 2026 evaluation | 65.5% | frontierswe.com for GPT-6 Astra on FrontierSWE 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)FrontierSWE ScoreReported Benchmark leaderboardProximalIndependentRecord for GPT-6 Astra on FrontierSWE 2 — October 2026 evaluation | 10005 |
| GPT-6 Astra (max) | Humanity's Last Exam Text only — Mercor single-shot | 52.2% | mercor.com for GPT-6 Astra (max) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-6 Astra on Humanity's Last Exam Text only — Mercor single-shot | 10005 |
| GPT-6 Astra (xHigh) | SWE Atlas Codebase QnA — Public; Codex | 59.1% | labs.scale.com for GPT-6 Astra (xHigh) on SWE Atlas Codebase QnA — Public; Codex (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for GPT-6 Astra on SWE Atlas Codebase QnA — Public; Codex | 10005 |
| GPT-6 Astra (max) | SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps | 47.8% | mercor.com for GPT-6 Astra (max) on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardMercorIndependentRecord for GPT-6 Astra on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps | 10005 |
| GPT-6 Astra (max) | MedXpertQA MM — Mercor single-shot | 86.8% | mercor.com for GPT-6 Astra (max) on MedXpertQA MM — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-6 Astra on MedXpertQA MM — Mercor single-shot | 10005 |
| GPT-6 Astra (xHigh) | SWE Atlas Refactoring — Codex | 59.1% | labs.scale.com for GPT-6 Astra (xHigh) on SWE Atlas Refactoring — Codex (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for GPT-6 Astra on SWE Atlas Refactoring — Codex | 10005 |
| GPT-6 Astra (max) | SimpleQA Verified Original — Epoch AI harness | 75.6% | epoch.ai for GPT-6 Astra (max) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-6 Astra on SimpleQA Verified Original — Epoch AI harness | 10005 |
| GPT-6 Astra (max) | Terminal-Bench 4.0 — Mercor mini-swe-agent | 54.5% | mercor.com for GPT-6 Astra (max) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-6 Astra on Terminal-Bench 4.0 — Mercor mini-swe-agent | 10005 |
| GPT-6 Astra (Max) | Chartography October 2026 leaderboard | 71.0% | surgehq.ai for GPT-6 Astra (Max) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for GPT-6 Astra on Chartography October 2026 leaderboard | 10005 |
| GPT-6 Astra (xhigh) | MedXpertQA MM — Mercor single-shot | 86.5% | mercor.com for GPT-6 Astra (xhigh) on MedXpertQA MM — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-6 Astra on MedXpertQA MM — Mercor single-shot | 10005 |
| GPT-6 Astra (high) | CWE-bench 1 — Codex | 68.0% | cwe-bench.com for GPT-6 Astra (high) on CWE-bench 1 — Codex (opens in a new tab)Archived copy (opens in a new tab)CWE-bench Programmatic Pass@1Reported Benchmark leaderboardCollinear AIIndependentRecord for GPT-6 Astra on CWE-bench 1 — Codex | 10005 |
| GPT-6 Astra (max) | MMLU-Pro Original — Mercor single-shot | 91.5% | mercor.com for GPT-6 Astra (max) on MMLU-Pro Original — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-6 Astra on MMLU-Pro Original — Mercor single-shot | 10005 |
| GPT-6 Astra (max) | APEX-Agents Original | 64.7% | mercor.com for GPT-6 Astra (max) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for GPT-6 Astra on APEX-Agents Original | 10005 |
| GPT-6 Astra (max) | GPQA Diamond — Epoch AI harness | 95.8% | epoch.ai for GPT-6 Astra (max) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-6 Astra on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness | 10005 |
| GPT-5.3-Codex (xHigh) | SWE Atlas Codebase QnA — Public; Codex | 32.6% | labs.scale.com for GPT-5.3-Codex (xHigh) on SWE Atlas Codebase QnA — Public; Codex (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for GPT-5.3-Codex on SWE Atlas Codebase QnA — Public; Codex | 10006 |
| GPT-5.3-Codex (high) | SWE-bench Verified — Epoch AI harness | 74.8% | epoch.ai for GPT-5.3-Codex (high) on SWE-bench Verified — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.3-Codex on SWE-bench Verified — Epoch AI harness | 10006 |
| GPT-5.3-Codex (xHigh) | SWE Atlas Refactoring — Codex | 42.4% | labs.scale.com for GPT-5.3-Codex (xHigh) on SWE Atlas Refactoring — Codex (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for GPT-5.3-Codex on SWE Atlas Refactoring — Codex | 10006 |