| Gemini 2.0 Flash | GPQA Diamond — Epoch AI harness | 64.1% | epoch.ai for Gemini 2.0 Flash on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Gemini 2.0 Flash on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness | 30001 |
| Gemini 2.5 Pro | Humanity's Last Exam Text only — Scale AI evaluation | 18.4% | labs.scale.com for Gemini 2.5 Pro on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Gemini 2.5 Pro on Humanity's Last Exam Text only — Scale AI evaluation | 30002 |
| Gemini 2.5 Pro | GPQA Diamond — Epoch AI harness | 83.8% | epoch.ai for Gemini 2.5 Pro on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Gemini 2.5 Pro on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness | 30002 |
| Gemini 2.5 Flash | Humanity's Last Exam Text only — Scale AI evaluation | 12.6% | labs.scale.com for Gemini 2.5 Flash on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Gemini 2.5 Flash on Humanity's Last Exam Text only — Scale AI evaluation | 30003 |
| Gemini 3.8 Flash (high) | SWE-bench Verified — Mercor mini-swe-agent, 1000 steps | 80.6% | mercor.com for Gemini 3.8 Flash (high) on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.8 Flash on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps | 30004 |
| Gemini 3.8 Flash (high) | Humanity's Last Exam Text only — Mercor single-shot | 47.0% | mercor.com for Gemini 3.8 Flash (high) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.8 Flash on Humanity's Last Exam Text only — Mercor single-shot | 30004 |
| Gemini 3.8 Flash | FrontierSWE 2 — October 2026 evaluation | 19.6% | frontierswe.com for Gemini 3.8 Flash on FrontierSWE 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)FrontierSWE ScoreReported Benchmark leaderboardProximalIndependentRecord for Gemini 3.8 Flash on FrontierSWE 2 — October 2026 evaluation | 30004 |
| Gemini 3.8 Flash (high) | CursorBench 4.0 | 39.6% | cursor.com for Gemini 3.8 Flash (high) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Gemini 3.8 Flash on CursorBench 4.0 | 30004 |
| Gemini 3.8 Flash (medium) | AutomationBench 1.0.6 | 29.7% | zapier.com for Gemini 3.8 Flash (medium) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Gemini 3.8 Flash on AutomationBench 1.0.6 | 30004 |
| Gemini 3.8 Flash (high) | MMMU-Pro 1,730 questions — Mercor single-shot | 85.3% | mercor.com for Gemini 3.8 Flash (high) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.8 Flash on MMMU-Pro 1,730 questions — Mercor single-shot | 30004 |
| Gemini 3.8 Flash (high) | APEX-Agents Original | 64.3% | mercor.com for Gemini 3.8 Flash (high) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.8 Flash on APEX-Agents Original | 30004 |
| Gemini 3.8 Flash (high) | AutomationBench 1.0.6 | 29.7% | zapier.com for Gemini 3.8 Flash (high) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Gemini 3.8 Flash on AutomationBench 1.0.6 | 30004 |
| Gemini 3.8 Flash (high) | MedXpertQA MM — Mercor single-shot | 84.7% | mercor.com for Gemini 3.8 Flash (high) on MedXpertQA MM — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.8 Flash on MedXpertQA MM — Mercor single-shot | 30004 |
| Gemini 3.8 Flash (medium) | CursorBench 4.0 | 37.3% | cursor.com for Gemini 3.8 Flash (medium) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Gemini 3.8 Flash on CursorBench 4.0 | 30004 |
| Gemini 3.8 Flash (high) | MMLU-Pro Original — Mercor single-shot | 90.7% | mercor.com for Gemini 3.8 Flash (high) on MMLU-Pro Original — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.8 Flash on MMLU-Pro Original — Mercor single-shot | 30004 |
| Gemini 3.8 Flash (high) | SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps | 85.8% | mercor.com for Gemini 3.8 Flash (high) on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.8 Flash on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps | 30004 |
| Gemini 3.8 Flash (high) | BrowseComp 130-question subset — Mercor web research agent | 83.1% | mercor.com for Gemini 3.8 Flash (high) on BrowseComp 130-question subset — Mercor web research agent (opens in a new tab)Archived copy (opens in a new tab)BrowseComp AccuracyReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.8 Flash on BrowseComp 130-question subset — Mercor web research agent | 30004 |
| Gemini 3.8 Flash (high) | CharXiv Descriptive and reasoning — Mercor single-shot | 95.4% | mercor.com for Gemini 3.8 Flash (high) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)CharXiv AccuracyReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.8 Flash on CharXiv Descriptive and reasoning — Mercor single-shot | 30004 |
| Gemini 3.8 Flash | Humanity's Last Exam Text only — Scale AI evaluation | 45.0% | labs.scale.com for Gemini 3.8 Flash on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Gemini 3.8 Flash on Humanity's Last Exam Text only — Scale AI evaluation | 30004 |
| Gemini 3.8 Flash (High) | Riemann-bench October 2026 leaderboard | 51.2% | surgehq.ai for Gemini 3.8 Flash (High) on Riemann-bench October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Riemann-bench Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Gemini 3.8 Flash on Riemann-bench October 2026 leaderboard | 30004 |
| Gemini 3.8 Flash (high) | GPQA Diamond — Mercor single-shot | 93.9% | mercor.com for Gemini 3.8 Flash (high) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.8 Flash on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot | 30004 |
| Gemini 3.8 Flash (high) | DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps | 71.4% | mercor.com for Gemini 3.8 Flash (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for Gemini 3.8 Flash on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps | 30004 |
| Gemini 3.8 Flash | SWE Atlas Codebase QnA — Public; mini-swe-agent | 47.0% | labs.scale.com for Gemini 3.8 Flash on SWE Atlas Codebase QnA — Public; mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Gemini 3.8 Flash on SWE Atlas Codebase QnA — Public; mini-swe-agent | 30004 |
| Gemini 3.8 Flash (high) | Terminal-Bench 4.0 — Mercor mini-swe-agent | 12.1% | mercor.com for Gemini 3.8 Flash (high) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.8 Flash on Terminal-Bench 4.0 — Mercor mini-swe-agent | 30004 |
| Gemini 3.8 Flash | SWE Atlas Refactoring — mini-swe-agent | 44.8% | labs.scale.com for Gemini 3.8 Flash on SWE Atlas Refactoring — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Gemini 3.8 Flash on SWE Atlas Refactoring — mini-swe-agent | 30004 |
| Gemini 3.8 Flash (high) | SimpleQA Verified Original — Epoch AI harness | 69.7% | epoch.ai for Gemini 3.8 Flash (high) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Gemini 3.8 Flash on SimpleQA Verified Original — Epoch AI harness | 30004 |
| Gemini 3.8 Flash (high) | GPQA Diamond — Epoch AI harness | 95.4% | epoch.ai for Gemini 3.8 Flash (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Gemini 3.8 Flash on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness | 30004 |
| Gemini 3.8 Flash (High) | Chartography October 2026 leaderboard | 40.9% | surgehq.ai for Gemini 3.8 Flash (High) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Gemini 3.8 Flash on Chartography October 2026 leaderboard | 30004 |
| Gemini 3.1 Pro (high) | DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps | 7.7% | mercor.com for Gemini 3.1 Pro (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for Gemini 3.1 Pro on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps | 30005 |
| Gemini 3.1 Pro (low) | AutomationBench 1.0.6 | 4.6% | zapier.com for Gemini 3.1 Pro (low) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Gemini 3.1 Pro on AutomationBench 1.0.6 | 30005 |
| Gemini 3.1 Pro (high) | SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps | 18.0% | mercor.com for Gemini 3.1 Pro (high) on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardMercorIndependentRecord for Gemini 3.1 Pro on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps | 30005 |
| Gemini 3.1 Pro (high) | MedXpertQA MM — Mercor single-shot | 80.2% | mercor.com for Gemini 3.1 Pro (high) on MedXpertQA MM — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.1 Pro on MedXpertQA MM — Mercor single-shot | 30005 |
| Gemini 3.1 Pro (high) | SimpleQA Verified Original — Epoch AI harness | 73.5% | epoch.ai for Gemini 3.1 Pro (high) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Gemini 3.1 Pro on SimpleQA Verified Original — Epoch AI harness | 30005 |
| Gemini 3.1 Pro (high) | BrowseComp 130-question subset — Mercor web research agent | 75.6% | mercor.com for Gemini 3.1 Pro (high) on BrowseComp 130-question subset — Mercor web research agent (opens in a new tab)Archived copy (opens in a new tab)BrowseComp AccuracyReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.1 Pro on BrowseComp 130-question subset — Mercor web research agent | 30005 |
| Gemini 3.1 Pro (high) | MMMU-Pro 1,730 questions — Mercor single-shot | 84.3% | mercor.com for Gemini 3.1 Pro (high) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.1 Pro on MMMU-Pro 1,730 questions — Mercor single-shot | 30005 |
| Gemini 3.1 Pro (high) | CharXiv Descriptive and reasoning — Mercor single-shot | 94.6% | mercor.com for Gemini 3.1 Pro (high) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)CharXiv AccuracyReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.1 Pro on CharXiv Descriptive and reasoning — Mercor single-shot | 30005 |
| Gemini 3.1 Pro (high) | GPQA Diamond — Epoch AI harness | 94.4% | epoch.ai for Gemini 3.1 Pro (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Gemini 3.1 Pro on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness | 30005 |
| Gemini 3.1 Pro (high) | APEX-Agents Original | 35.3% | mercor.com for Gemini 3.1 Pro (high) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.1 Pro on APEX-Agents Original | 30005 |
| Gemini 3.1 Pro (thinking) | SWE-bench Pro Private — Scale AI mini-swe-agent | 32.2% | labs.scale.com for Gemini 3.1 Pro (thinking) on SWE-bench Pro Private — Scale AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Public tasks resolvedReported Benchmark leaderboardScale AIIndependentRecord for Gemini 3.1 Pro on SWE-bench Pro Private — Scale AI mini-swe-agent | 30005 |
| Gemini 3.1 Pro (thinking high) | Humanity's Last Exam Text only — Scale AI evaluation | 47.3% | labs.scale.com for Gemini 3.1 Pro (thinking high) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Gemini 3.1 Pro on Humanity's Last Exam Text only — Scale AI evaluation | 30005 |
| Gemini 3.1 Pro (High) | Riemann-bench October 2026 leaderboard | 33.6% | surgehq.ai for Gemini 3.1 Pro (High) on Riemann-bench October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Riemann-bench Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Gemini 3.1 Pro on Riemann-bench October 2026 leaderboard | 30005 |
| Gemini 3.1 Pro | GPQA Diamond — Epoch AI harness | 94.1% | epoch.ai for Gemini 3.1 Pro on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Gemini 3.1 Pro on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness | 30005 |
| Gemini 3.1 Pro (high) | Terminal-Bench 2.1 — Mercor Terminus 2 | 72.7% | mercor.com for Gemini 3.1 Pro (high) on Terminal-Bench 2.1 — Mercor Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.1 Pro on Terminal-Bench 2.1 — Mercor Terminus 2 | 30005 |
| Gemini 3.1 Pro (high) | SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps | 65.1% | mercor.com for Gemini 3.1 Pro (high) on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.1 Pro on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps | 30005 |
| Gemini 3.1 Pro (high) | SWE-bench Verified — Mercor mini-swe-agent, 1000 steps | 78.4% | mercor.com for Gemini 3.1 Pro (high) on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.1 Pro on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps | 30005 |
| Gemini 3.1 Pro (high) | GPQA Diamond — Mercor single-shot | 94.2% | mercor.com for Gemini 3.1 Pro (high) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.1 Pro on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot | 30005 |
| Gemini 3.1 Pro (high) | MMLU-Pro Original — Mercor single-shot | 91.3% | mercor.com for Gemini 3.1 Pro (high) on MMLU-Pro Original — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.1 Pro on MMLU-Pro Original — Mercor single-shot | 30005 |
| Gemini 3.1 Pro (medium) | AutomationBench 1.0.6 | 7.0% | zapier.com for Gemini 3.1 Pro (medium) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Gemini 3.1 Pro on AutomationBench 1.0.6 | 30005 |
| Gemini 3.1 Pro (high) | AutomationBench 1.0.6 | 8.7% | zapier.com for Gemini 3.1 Pro (high) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Gemini 3.1 Pro on AutomationBench 1.0.6 | 30005 |
| Gemini 3.1 Pro | SWE Atlas Refactoring — Gemini CLI | 33.8% | labs.scale.com for Gemini 3.1 Pro on SWE Atlas Refactoring — Gemini CLI (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Gemini 3.1 Pro on SWE Atlas Refactoring — Gemini CLI | 30005 |