Benchmarks

28 results across 15 benchmarks

Benchmark results for Gemini 3 Flash
BenchmarkScoreSource
Finance Agent Benchmark 2 — October 2026 evaluationEffort: High42.6%vals.ai for Gemini 3 Flash (high) on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Finance Agent AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Gemini 3 Flash on Finance Agent Benchmark 2 — October 2026 evaluation
GPQA Diamond90.4%blog.google for Gemini 3 Flash on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Launch postGoogleSelf-reportedGoogle DeepMindRecord for Gemini 3 Flash on Graduate-Level Google-Proof Q&A Diamond
GPQA Diamond — Epoch AI harnessEffort: HighConfiguration: Epoch AI harness89.4%epoch.ai for Gemini 3 Flash (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Gemini 3 Flash on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Epoch AI harnessConfiguration: Epoch AI harness83.2%epoch.ai for Gemini 3 Flash on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Gemini 3 Flash on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Vals AI harnessEffort: HighConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT87.9%vals.ai for Gemini 3 Flash (high) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Gemini 3 Flash on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
HLAB October 2026 evaluationEffort: High0.0%vals.ai for Gemini 3 Flash (high) on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)HLAB Task Pass RateReported Benchmark leaderboardVals AIIndependentRecord for Gemini 3 Flash on Harvey's Legal Agent Benchmark October 2026 evaluation
Humanity's Last Exam Full set — No toolsConfiguration: No tools33.7%blog.google for Gemini 3 Flash on Humanity's Last Exam Full set — No tools (opens in a new tab)Humanity's Last Exam AccuracyReported Launch postGoogleSelf-reportedGoogle DeepMindRecord for Gemini 3 Flash on Humanity's Last Exam Full set — No tools
MCP Atlas Public, April 2026 update62.0%labs.scale.com for Gemini 3 Flash on MCP Atlas Public, April 2026 update (opens in a new tab)Pass rateReported Benchmark leaderboardScale AIIndependentRecord for Gemini 3 Flash on MCP Atlas Public, April 2026 update
MMLU-Pro Original — Vals AI harnessEffort: HighConfiguration: Vals AI harness88.6%vals.ai for Gemini 3 Flash (high) on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Gemini 3 Flash on MMLU-Pro Original — Vals AI harness
MMMU-Pro No toolsConfiguration: No tools81.2%blog.google for Gemini 3 Flash on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Overall (Standard 10 options + Vision)Reported Launch postGoogleSelf-reportedGoogle DeepMindRecord for Gemini 3 Flash on MMMU-Pro No tools
MMMU-Pro Vals AI harnessEffort: HighConfiguration: Vals AI harness87.6%vals.ai for Gemini 3 Flash (high) on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for Gemini 3 Flash on MMMU-Pro Vals AI harness
SimpleQA Verified Original — Epoch AI harnessEffort: HighConfiguration: Epoch AI harness66.8%epoch.ai for Gemini 3 Flash (high) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Gemini 3 Flash on SimpleQA Verified Original — Epoch AI harness
SWE Atlas Codebase QnA — Public; mini-swe-agentConfiguration: mini-swe-agent harness8.2%labs.scale.com for Gemini 3 Flash on SWE Atlas Codebase QnA — Public; mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Gemini 3 Flash on SWE Atlas Codebase QnA — Public; mini-swe-agent
SWE Atlas Refactoring — mini-swe-agentConfiguration: mini-swe-agent harness10.0%labs.scale.com for Gemini 3 Flash on SWE Atlas Refactoring — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Gemini 3 Flash on SWE Atlas Refactoring — mini-swe-agent
SWE-bench Multilingual — mini-swe-agentConfiguration: mini-swe-agent harness72.7%github.com for Gemini 3 Flash on SWE-bench Multilingual — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark repositorySWE-benchIndependentSWE-bench TeamRecord for Gemini 3 Flash on SWE-bench Multilingual — mini-swe-agent
SWE-bench Verified78.0%blog.google for Gemini 3 Flash on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postGoogleSelf-reportedGoogle DeepMindRecord for Gemini 3 Flash on SWE-bench Verified
SWE-bench Verified — Epoch AI harnessConfiguration: Epoch AI harness75.4%epoch.ai for Gemini 3 Flash on SWE-bench Verified — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Gemini 3 Flash on SWE-bench Verified — Epoch AI harness
SWE-bench Verified — mini-swe-agentEffort: HighConfiguration: mini-swe-agent harness75.8%github.com for Gemini 3 Flash (high) on SWE-bench Verified — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark repositorySWE-benchIndependentSWE-bench TeamRecord for Gemini 3 Flash on SWE-bench Verified — mini-swe-agent
SWE-bench Verified — Vals AI mini-swe-agentEffort: HighConfiguration: mini-swe-agent harness75.0%vals.ai for Gemini 3 Flash (high) on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardVals AIIndependentRecord for Gemini 3 Flash on SWE-bench Verified — Vals AI mini-swe-agent
SWE-bench Pro Public — Scale AI SWE-AgentConfiguration: SWE-Agent harness, 250 turns, uncapped cost34.6%labs.scale.com for Gemini 3 Flash on SWE-bench Pro Public — Scale AI SWE-Agent (opens in a new tab)Archived copy (opens in a new tab)Public tasks resolvedReported Benchmark leaderboardScale AIIndependentRecord for Gemini 3 Flash on SWE-bench Pro Public — Scale AI SWE-Agent
Terminal-Bench 2.0 — Vals AI Terminus 2Effort: HighConfiguration: Terminus-2 harness51.7%vals.ai for Gemini 3 Flash (high) on Terminal-Bench 2.0 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Gemini 3 Flash on Terminal-Bench 2.0 — Vals AI Terminus 2
Terminal-Bench 2.1 — Vals AI Terminus 2Effort: HighConfiguration: Terminus-2 harness53.9%vals.ai for Gemini 3 Flash (high) on Terminal-Bench 2.1 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Gemini 3 Flash on Terminal-Bench 2.1 — Vals AI Terminus 2
Toolathlon Original49.4%toolathlon.xyz for Gemini 3 Flash on Toolathlon Original (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for Gemini 3 Flash on Toolathlon Original
Vibe Code Bench 1.1 — OpenHands, October 2026 evaluationEffort: HighConfiguration: OpenHands harness20.2%vals.ai for Gemini 3 Flash (high) on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for Gemini 3 Flash on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation
τ³-bench τ³ — AirlineEffort: High82.5%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Gemini 3 Flash (high) on τ³-bench τ³ — Airline (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Gemini 3 Flash on τ³-bench τ³ — Airline
τ³-bench τ³ — Banking, Terminal retrieval, v1.0.1 gradingEffort: HighConfiguration: Terminal retrieval27.3%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Gemini 3 Flash (high) on τ³-bench τ³ — Banking, Terminal retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Gemini 3 Flash on τ³-bench τ³ — Banking, Terminal retrieval, v1.0.1 grading
τ³-bench τ³ — RetailEffort: High76.8%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Gemini 3 Flash (high) on τ³-bench τ³ — Retail (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Gemini 3 Flash on τ³-bench τ³ — Retail
τ³-bench τ³ — TelecomEffort: High91.2%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Gemini 3 Flash (high) on τ³-bench τ³ — Telecom (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Gemini 3 Flash on τ³-bench τ³ — Telecom