Benchmarks

26 results across 11 benchmarks

Benchmark results for Gemini 3 Pro
BenchmarkScoreSource
GPQA DiamondEffort: High91.9%blog.google for Gemini 3 Pro (high) on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Launch postGoogleSelf-reportedGoogle DeepMindRecord for Gemini 3 Pro on Graduate-Level Google-Proof Q&A Diamond
GPQA Diamond — Epoch AI harnessConfiguration: Epoch AI harness92.6%epoch.ai for Gemini 3 Pro on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Gemini 3 Pro on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Vals AI harnessEffort: HighConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT91.7%vals.ai for Gemini 3 Pro (high) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Gemini 3 Pro on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
Humanity's Last Exam Full set — No toolsEffort: HighConfiguration: No tools37.5%blog.google for Gemini 3 Pro (high) on Humanity's Last Exam Full set — No tools (opens in a new tab)Humanity's Last Exam AccuracyReported Launch postGoogleSelf-reportedGoogle DeepMindRecord for Gemini 3 Pro on Humanity's Last Exam Full set — No tools
Humanity's Last Exam Full set — Scale AI evaluation37.5%labs.scale.com for Gemini 3 Pro on Humanity's Last Exam Full set — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Gemini 3 Pro on Humanity's Last Exam Full set — Scale AI evaluation
Humanity's Last Exam Text only — Scale AI evaluation37.7%labs.scale.com for Gemini 3 Pro on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Gemini 3 Pro on Humanity's Last Exam Text only — Scale AI evaluation
MCP Atlas Public, April 2026 update70.3%labs.scale.com for Gemini 3 Pro on MCP Atlas Public, April 2026 update (opens in a new tab)Pass rateReported Benchmark leaderboardScale AIIndependentRecord for Gemini 3 Pro on MCP Atlas Public, April 2026 update
MMLU-Pro Original — Vals AI harnessConfiguration: Vals AI harness90.1%vals.ai for Gemini 3 Pro on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Gemini 3 Pro on MMLU-Pro Original — Vals AI harness
MMMU-Pro No toolsEffort: HighConfiguration: No tools81.0%blog.google for Gemini 3 Pro (high) on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Overall (Standard 10 options + Vision)Reported Launch postGoogleSelf-reportedGoogle DeepMindRecord for Gemini 3 Pro on MMMU-Pro No tools
MMMU-Pro Vals AI harnessEffort: HighConfiguration: Vals AI harness87.5%vals.ai for Gemini 3 Pro (high) on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for Gemini 3 Pro on MMMU-Pro Vals AI harness
SWE-bench Multilingual — mini-swe-agentConfiguration: mini-swe-agent harness68.7%github.com for Gemini 3 Pro on SWE-bench Multilingual — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark repositorySWE-benchIndependentSWE-bench TeamRecord for Gemini 3 Pro on SWE-bench Multilingual — mini-swe-agent
SWE-bench VerifiedEffort: High76.2%blog.google for Gemini 3 Pro (high) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postGoogleSelf-reportedGoogle DeepMindRecord for Gemini 3 Pro on SWE-bench Verified
SWE-bench Verified — Epoch AI harnessConfiguration: Epoch AI harness72.9%epoch.ai for Gemini 3 Pro on SWE-bench Verified — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Gemini 3 Pro on SWE-bench Verified — Epoch AI harness
SWE-bench Verified — mini-swe-agentEffort: HighConfiguration: mini-swe-agent harness69.6%github.com for Gemini 3 Pro (high) on SWE-bench Verified — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark repositorySWE-benchIndependentSWE-bench TeamRecord for Gemini 3 Pro on SWE-bench Verified — mini-swe-agent
SWE-bench Verified — mini-swe-agentConfiguration: mini-swe-agent harness74.2%github.com for Gemini 3 Pro on SWE-bench Verified — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark repositorySWE-benchIndependentSWE-bench TeamRecord for Gemini 3 Pro on SWE-bench Verified — mini-swe-agent
SWE-bench Verified — Vals AI mini-swe-agentEffort: HighConfiguration: mini-swe-agent harness76.4%vals.ai for Gemini 3 Pro (high) on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardVals AIIndependentRecord for Gemini 3 Pro on SWE-bench Verified — Vals AI mini-swe-agent
SWE-bench Pro Private — Scale AI SWE-AgentConfiguration: SWE-Agent harness, 250 turns, uncapped cost17.9%labs.scale.com for Gemini 3 Pro on SWE-bench Pro Private — Scale AI SWE-Agent (opens in a new tab)Archived copy (opens in a new tab)Public tasks resolvedReported Benchmark leaderboardScale AIIndependentRecord for Gemini 3 Pro on SWE-bench Pro Private — Scale AI SWE-Agent
SWE-bench Pro Public — Scale AI SWE-AgentConfiguration: SWE-Agent harness, 250 turns, uncapped cost43.3%labs.scale.com for Gemini 3 Pro on SWE-bench Pro Public — Scale AI SWE-Agent (opens in a new tab)Archived copy (opens in a new tab)Public tasks resolvedReported Benchmark leaderboardScale AIIndependentRecord for Gemini 3 Pro on SWE-bench Pro Public — Scale AI SWE-Agent
Terminal-Bench 2.0Effort: High54.2%blog.google for Gemini 3 Pro (high) on Terminal-Bench 2.0 (opens in a new tab)Terminal-Bench AccuracyReported Launch postGoogleSelf-reportedGoogle DeepMindRecord for Gemini 3 Pro on Terminal-Bench 2.0
Terminal-Bench 2.0 — Vals AI Terminus 2Effort: HighConfiguration: Terminus-2 harness55.1%vals.ai for Gemini 3 Pro (high) on Terminal-Bench 2.0 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Gemini 3 Pro on Terminal-Bench 2.0 — Vals AI Terminus 2
Toolathlon Original36.4%toolathlon.xyz for Gemini 3 Pro on Toolathlon Original (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for Gemini 3 Pro on Toolathlon Original
Vibe Code Bench 1.1 — OpenHands, October 2026 evaluationEffort: HighConfiguration: OpenHands harness14.3%vals.ai for Gemini 3 Pro (high) on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for Gemini 3 Pro on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation
τ³-bench τ³ — AirlineEffort: High80.5%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Gemini 3 Pro (high) on τ³-bench τ³ — Airline (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Gemini 3 Pro on τ³-bench τ³ — Airline
τ³-bench τ³ — Banking, Terminal retrieval, v1.0.1 gradingEffort: HighConfiguration: Terminal retrieval18.0%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Gemini 3 Pro (high) on τ³-bench τ³ — Banking, Terminal retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Gemini 3 Pro on τ³-bench τ³ — Banking, Terminal retrieval, v1.0.1 grading
τ³-bench τ³ — RetailEffort: High75.9%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Gemini 3 Pro (high) on τ³-bench τ³ — Retail (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Gemini 3 Pro on τ³-bench τ³ — Retail
τ³-bench τ³ — TelecomEffort: High91.0%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Gemini 3 Pro (high) on τ³-bench τ³ — Telecom (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Gemini 3 Pro on τ³-bench τ³ — Telecom