GPQA Diamond 82.8% storage.googleapis.com for Gemini 2.5 Flash on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab) GPQA Diamond Accuracy Reported July 2, 2025 Technical report Google Self-reported Google DeepMind Record for Gemini 2.5 Flash on Graduate-Level Google-Proof Q&A Diamond GPQA Diamond — Vals AI harness Configuration: Vals AI harness: mean of zero-shot and few-shot CoT 57.6% vals.ai for Gemini 2.5 Flash on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab) Archived copy (opens in a new tab) GPQA Diamond Accuracy Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Gemini 2.5 Flash on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness Humanity's Last Exam Full set — Scale AI evaluation 12.1% labs.scale.com for Gemini 2.5 Flash on Humanity's Last Exam Full set — Scale AI evaluation (opens in a new tab) Archived copy (opens in a new tab) Humanity's Last Exam Accuracy Reported October 3, 2026 Benchmark leaderboard Scale AI Independent Record for Gemini 2.5 Flash on Humanity's Last Exam Full set — Scale AI evaluation Humanity's Last Exam Text only — Scale AI evaluation 12.6% labs.scale.com for Gemini 2.5 Flash on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab) Archived copy (opens in a new tab) Humanity's Last Exam Accuracy Reported October 7, 2026 Benchmark leaderboard Scale AI Independent Record for Gemini 2.5 Flash on Humanity's Last Exam Text only — Scale AI evaluation MMMU 79.7% storage.googleapis.com for Gemini 2.5 Flash on Massive Multi-discipline Multimodal Understanding MMMU (opens in a new tab) MMMU Accuracy Reported July 2, 2025 Technical report Google Self-reported Google DeepMind Record for Gemini 2.5 Flash on Massive Multi-discipline Multimodal Understanding MMMU MMMU-Pro Vals AI harness Configuration: Vals AI harness 68.0% vals.ai for Gemini 2.5 Flash on MMMU-Pro Vals AI harness (opens in a new tab) Archived copy (opens in a new tab) MMMU-Pro accuracy Setting: Standard (4 options) Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Gemini 2.5 Flash on MMMU-Pro Vals AI harness MMMU-Pro Vals AI harness Reported as: thinking Configuration: Vals AI harness 71.9% vals.ai for Gemini 2.5 Flash (thinking) on MMMU-Pro Vals AI harness (opens in a new tab) Archived copy (opens in a new tab) MMMU-Pro accuracy Setting: Standard (4 options) Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Gemini 2.5 Flash on MMMU-Pro Vals AI harness SWE-bench Verified 48.9% storage.googleapis.com for Gemini 2.5 Flash on SWE-bench Verified (opens in a new tab) Resolved Tasks Reported July 2, 2025 Technical report Google Self-reported Google DeepMind Record for Gemini 2.5 Flash on SWE-bench Verified SWE-bench Verified — mini-swe-agent Configuration: mini-swe-agent harness 28.7% github.com for Gemini 2.5 Flash on SWE-bench Verified — mini-swe-agent (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported July 26, 2025 Benchmark repository SWE-bench Independent SWE-bench Team Record for Gemini 2.5 Flash on SWE-bench Verified — mini-swe-agent