Gemini 3.7 Flash vs Gemini 3.8 Flash
34 shared benchmark contexts with reported scores and primary source links.
Gemini 3.7 FlashGemini 3.8 Flash
Change models in the comparison toolShared benchmarks
34| Benchmark | Gemini 3.7 Flash | Gemini 3.8 Flash |
|---|---|---|
|
| |
Evaluation details for APEX-Agents OriginalThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Gemini 3.7 Flash Gemini 3.8 Flash | ||
|
| |
Evaluation details for AutomationBench 1.0.6The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for BrowseComp 130-question subset — Mercor web research agentThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for Chartography October 2026 leaderboardThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for CharXiv Descriptive and reasoning — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for CharXiv Reasoning — No toolsThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Gemini 3.7 Flash Gemini 3.8 Flash | ||
DeepSWE 1.1Potentially non-equivalent: Evaluator sets differ. |
|
|
Potentially non-equivalent · Evaluation details for DeepSWE 1.1Evaluator sets differ. Evaluation methodology is not recorded by the registry. Gemini 3.7 Flash Gemini 3.8 Flash | ||
|
| |
Evaluation details for DeepSWE 1.1 — Mercor mini-swe-agent, 500 stepsThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for Finance Agent Benchmark 2 — October 2026 evaluationThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for FrontierSWE 2 — October 2026 evaluationThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for GDP.pdfThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Gemini 3.7 Flash Gemini 3.8 Flash | ||
|
| |
Evaluation details for GPQA Diamond — Epoch AI harnessThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for GPQA Diamond — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for GPQA Diamond — Vals AI harnessThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for HLAB October 2026 evaluationThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for HLE-Verified Full 1,811-item verified setThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for Humanity's Last Exam Text only — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for LVBench 1024 frames — StaticThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Gemini 3.7 Flash Gemini 3.8 Flash | ||
|
| |
Evaluation details for MedXpertQA MM — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for MMLU-Pro Original — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for MMLU-Pro Original — Vals AI harnessThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for MMMU-Pro 1,730 questions — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for MMMU-Pro Vals AI harnessThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Gemini 3.7 Flash Gemini 3.8 Flash | ||
|
| |
Evaluation details for Riemann-bench October 2026 leaderboardThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SimpleQA Verified Original — Epoch AI harnessThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SWE-bench Multilingual — Mercor mini-swe-agent, 1000 stepsThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SWE-bench Verified — Mercor mini-swe-agent, 1000 stepsThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SWE-bench Verified — Vals AI mini-swe-agentThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for Terminal-Bench 2.1The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Gemini 3.7 Flash Gemini 3.8 Flash | ||
|
| |
Evaluation details for Terminal-Bench 2.1 — Vals AI Terminus 2The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for Terminal-Bench 4.0 — mini-swe-agentThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for Terminal-Bench 4.0 — Vals AI mini-swe-agentThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for Vals Index 2.1The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Gemini 3.7 Flash Gemini 3.8 Flash | ||
|
| |
Evaluation details for Vibe Code Bench 1.1 — OpenHands, October 2026 evaluationThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||