APEX-Agents Original Effort: High 27.5% mercor.com for Gemini 3.5 Flash (high) on APEX-Agents Original (opens in a new tab) Archived copy (opens in a new tab) Pass rate Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Gemini 3.5 Flash on APEX-Agents Original AutomationBench 1.0.6 Effort: Low 9.0% zapier.com for Gemini 3.5 Flash (low) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Gemini 3.5 Flash on AutomationBench 1.0.6 AutomationBench 1.0.6 Effort: Medium 11.4% zapier.com for Gemini 3.5 Flash (medium) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Gemini 3.5 Flash on AutomationBench 1.0.6 AutomationBench 1.0.6 Effort: High 13.4% zapier.com for Gemini 3.5 Flash (high) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Gemini 3.5 Flash on AutomationBench 1.0.6 BrowseComp 130-question subset — Mercor web research agent Effort: High Configuration: Mercor web research agent, 100 steps, 3 hours 43.3% mercor.com for Gemini 3.5 Flash (high) on BrowseComp 130-question subset — Mercor web research agent (opens in a new tab) Archived copy (opens in a new tab) BrowseComp Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Gemini 3.5 Flash on BrowseComp 130-question subset — Mercor web research agent CharXiv Descriptive and reasoning — Mercor single-shot Effort: High Configuration: Mercor single-shot agent 94.3% mercor.com for Gemini 3.5 Flash (high) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab) Archived copy (opens in a new tab) CharXiv Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Gemini 3.5 Flash on CharXiv Descriptive and reasoning — Mercor single-shot CharXiv Reasoning — No tools Configuration: No tools 84.2% deepmind.google for Gemini 3.5 Flash on CharXiv Reasoning — No tools (opens in a new tab) CharXiv Accuracy Reported May 19, 2026 Model card Google DeepMind Self-reported Record for Gemini 3.5 Flash on CharXiv Reasoning — No tools CharXiv Reasoning — Search and code execution Configuration: Search and code execution 84.9% deepmind.google for Gemini 3.5 Flash on CharXiv Reasoning — Search and code execution (opens in a new tab) CharXiv Accuracy Reported July 21, 2026 Model card Google DeepMind Self-reported Record for Gemini 3.5 Flash on CharXiv Reasoning — Search and code execution DeepSWE 1.1 Effort: High 36.0% deepswe.datacurve.ai for Gemini 3.5 Flash (high) on DeepSWE 1.1 (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported September 22, 2026 Benchmark leaderboard Datacurve Independent Record for Gemini 3.5 Flash on DeepSWE 1.1 DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps Effort: High Configuration: Mercor mini-swe-agent, 500 steps, 2 hours 36.6% mercor.com for Gemini 3.5 Flash (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Gemini 3.5 Flash on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps Finance Agent Benchmark 2 — October 2026 evaluation Effort: High 57.9% vals.ai for Gemini 3.5 Flash (high) on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab) Archived copy (opens in a new tab) Finance Agent Accuracy Reported October 6, 2026 Benchmark leaderboard Vals AI Independent Record for Gemini 3.5 Flash on Finance Agent Benchmark 2 — October 2026 evaluation GPQA Diamond — Epoch AI harness Effort: Low Configuration: Epoch AI harness 88.9% epoch.ai for Gemini 3.5 Flash (low) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) GPQA Diamond Accuracy Reported October 7, 2026 Evaluated August 6, 2026 at 10:30 PM UTC Benchmark leaderboard Epoch AI Independent Record for Gemini 3.5 Flash on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness GPQA Diamond — Epoch AI harness Effort: High Configuration: Epoch AI harness 92.8% epoch.ai for Gemini 3.5 Flash (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) GPQA Diamond Accuracy Reported October 7, 2026 Evaluated May 22, 2026 at 4:02 PM UTC Benchmark leaderboard Epoch AI Independent Record for Gemini 3.5 Flash on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness GPQA Diamond — Mercor single-shot Effort: High Configuration: Mercor single-shot agent 85.7% mercor.com for Gemini 3.5 Flash (high) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab) Archived copy (opens in a new tab) GPQA Diamond Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Gemini 3.5 Flash on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot GPQA Diamond — Vals AI harness Effort: High Configuration: Vals AI harness: mean of zero-shot and few-shot CoT 92.7% vals.ai for Gemini 3.5 Flash (high) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab) Archived copy (opens in a new tab) GPQA Diamond Accuracy Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Gemini 3.5 Flash on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness HLAB October 2026 evaluation Effort: High 2.5% vals.ai for Gemini 3.5 Flash (high) on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab) Archived copy (opens in a new tab) HLAB Task Pass Rate Reported October 6, 2026 Benchmark leaderboard Vals AI Independent Record for Gemini 3.5 Flash on Harvey's Legal Agent Benchmark October 2026 evaluation Humanity's Last Exam Full set — No tools Configuration: No tools 40.2% deepmind.google for Gemini 3.5 Flash on Humanity's Last Exam Full set — No tools (opens in a new tab) Humanity's Last Exam Accuracy Reported May 19, 2026 Model card Google DeepMind Self-reported Record for Gemini 3.5 Flash on Humanity's Last Exam Full set — No tools Humanity's Last Exam Text only — Mercor single-shot Effort: High Configuration: Mercor single-shot agent 40.6% mercor.com for Gemini 3.5 Flash (high) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab) Archived copy (opens in a new tab) Humanity's Last Exam Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Gemini 3.5 Flash on Humanity's Last Exam Text only — Mercor single-shot MCP Atlas Public, April 2026 update Effort: High 83.6% labs.scale.com for Gemini 3.5 Flash (high) on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for Gemini 3.5 Flash on MCP Atlas Public, April 2026 update MedXpertQA MM — Mercor single-shot Effort: High Configuration: Mercor single-shot agent 83.5% mercor.com for Gemini 3.5 Flash (high) on MedXpertQA MM — Mercor single-shot (opens in a new tab) Archived copy (opens in a new tab) Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Gemini 3.5 Flash on MedXpertQA MM — Mercor single-shot MMLU-Pro Original — Mercor single-shot Effort: High Configuration: Mercor single-shot agent 90.0% mercor.com for Gemini 3.5 Flash (high) on MMLU-Pro Original — Mercor single-shot (opens in a new tab) Archived copy (opens in a new tab) Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Gemini 3.5 Flash on MMLU-Pro Original — Mercor single-shot MMLU-Pro Original — Vals AI harness Effort: High Configuration: Vals AI harness 89.5% vals.ai for Gemini 3.5 Flash (high) on MMLU-Pro Original — Vals AI harness (opens in a new tab) Archived copy (opens in a new tab) Accuracy Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Gemini 3.5 Flash on MMLU-Pro Original — Vals AI harness MMMU-Pro 1,730 questions — Mercor single-shot Effort: High Configuration: Mercor single-shot agent 84.7% mercor.com for Gemini 3.5 Flash (high) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab) Archived copy (opens in a new tab) MMMU-Pro accuracy Setting: Not stated Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Gemini 3.5 Flash on MMMU-Pro 1,730 questions — Mercor single-shot MMMU-Pro No tools Configuration: No tools 83.6% deepmind.google for Gemini 3.5 Flash on MMMU-Pro No tools (opens in a new tab) MMMU-Pro accuracy Setting: Overall (Standard 10 options + Vision) Reported May 19, 2026 Model card Google DeepMind Self-reported Record for Gemini 3.5 Flash on MMMU-Pro No tools MMMU-Pro Vals AI harness Effort: High Configuration: Vals AI harness 88.3% vals.ai for Gemini 3.5 Flash (high) on MMMU-Pro Vals AI harness (opens in a new tab) Archived copy (opens in a new tab) MMMU-Pro accuracy Setting: Standard (4 options) Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Gemini 3.5 Flash on MMMU-Pro Vals AI harness OSWorld Verified 78.4% deepmind.google for Gemini 3.5 Flash on OSWorld Verified (opens in a new tab) OSWorld-Verified success rate Reported May 19, 2026 Model card Google DeepMind Self-reported Record for Gemini 3.5 Flash on OSWorld Verified Riemann-bench October 2026 leaderboard Effort: High 36.8% surgehq.ai for Gemini 3.5 Flash (High) on Riemann-bench October 2026 leaderboard (opens in a new tab) Archived copy (opens in a new tab) Riemann-bench Pass@1 Reported October 7, 2026 Benchmark leaderboard Surge AI Independent Record for Gemini 3.5 Flash on Riemann-bench October 2026 leaderboard SimpleQA Verified Original — Epoch AI harness Effort: High Configuration: Epoch AI harness 66.2% epoch.ai for Gemini 3.5 Flash (high) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Accuracy Reported October 7, 2026 Evaluated August 27, 2026 at 7:30 PM UTC Benchmark leaderboard Epoch AI Independent Record for Gemini 3.5 Flash on SimpleQA Verified Original — Epoch AI harness SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps Effort: High Configuration: Mercor mini-swe-agent, 250 steps, 1 hour 19.6% mercor.com for Gemini 3.5 Flash (high) on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps (opens in a new tab) Archived copy (opens in a new tab) Mean pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Gemini 3.5 Flash on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps Effort: High Configuration: Mercor mini-swe-agent, 1000 steps, 3 hours 68.2% mercor.com for Gemini 3.5 Flash (high) on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Gemini 3.5 Flash on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps SWE-bench Verified — Epoch AI harness Effort: High Configuration: Epoch AI harness 79.3% epoch.ai for Gemini 3.5 Flash (high) on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated June 1, 2026 at 10:22 AM UTC Benchmark leaderboard Epoch AI Independent Record for Gemini 3.5 Flash on SWE-bench Verified — Epoch AI harness SWE-bench Verified — Mercor mini-swe-agent, 1000 steps Effort: High Configuration: Mercor mini-swe-agent, 1000 steps, 3 hours 78.5% mercor.com for Gemini 3.5 Flash (high) on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Gemini 3.5 Flash on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps SWE-bench Verified — Vals AI mini-swe-agent Effort: High Configuration: mini-swe-agent harness 78.8% vals.ai for Gemini 3.5 Flash (high) on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Gemini 3.5 Flash on SWE-bench Verified — Vals AI mini-swe-agent SWE-bench Pro Public 55.1% deepmind.google for Gemini 3.5 Flash on SWE-bench Pro Public (opens in a new tab) Public tasks resolved Reported May 19, 2026 Model card Google DeepMind Self-reported Record for Gemini 3.5 Flash on SWE-bench Pro Public Terminal-Bench 2.0 — Vals AI Terminus 2 Effort: High Configuration: Terminus-2 harness 67.4% vals.ai for Gemini 3.5 Flash (high) on Terminal-Bench 2.0 — Vals AI Terminus 2 (opens in a new tab) Archived copy (opens in a new tab) Terminal-Bench Accuracy Reported June 4, 2026 Benchmark leaderboard Vals AI Independent Record for Gemini 3.5 Flash on Terminal-Bench 2.0 — Vals AI Terminus 2 Terminal-Bench 2.1 76.2% deepmind.google for Gemini 3.5 Flash on Terminal-Bench 2.1 (opens in a new tab) Terminal-Bench Accuracy Reported May 19, 2026 Model card Google DeepMind Self-reported Record for Gemini 3.5 Flash on Terminal-Bench 2.1 Terminal-Bench 2.1 — Mercor Terminus 2 Effort: High Configuration: Mercor Terminus 2, 1000 steps, 3 hours 73.8% mercor.com for Gemini 3.5 Flash (high) on Terminal-Bench 2.1 — Mercor Terminus 2 (opens in a new tab) Archived copy (opens in a new tab) Terminal-Bench Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Gemini 3.5 Flash on Terminal-Bench 2.1 — Mercor Terminus 2 Terminal-Bench 2.1 — Vals AI Terminus 2 Effort: High Configuration: Terminus-2 harness 74.2% vals.ai for Gemini 3.5 Flash (high) on Terminal-Bench 2.1 — Vals AI Terminus 2 (opens in a new tab) Archived copy (opens in a new tab) Terminal-Bench Accuracy Reported September 28, 2026 Benchmark leaderboard Vals AI Independent Record for Gemini 3.5 Flash on Terminal-Bench 2.1 — Vals AI Terminus 2 Terminal-Bench 4.0 — Vals AI mini-swe-agent Effort: High Configuration: mini-swe-agent harness 6.1% vals.ai for Gemini 3.5 Flash (high) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab) Archived copy (opens in a new tab) Terminal-Bench Accuracy Reported October 6, 2026 Benchmark leaderboard Vals AI Independent Record for Gemini 3.5 Flash on Terminal-Bench 4.0 — Vals AI mini-swe-agent Toolathlon Original 56.5% deepmind.google for Gemini 3.5 Flash on Toolathlon Original (opens in a new tab) Tasks completed Reported May 19, 2026 Model card Google DeepMind Self-reported Record for Gemini 3.5 Flash on Toolathlon Original Toolathlon Verified Effort: High 67.3% toolathlon.xyz for Gemini 3.5 Flash (high) on Toolathlon Verified (opens in a new tab) Archived copy (opens in a new tab) Tasks completed Reported June 30, 2026 Benchmark leaderboard Toolathlon Independent Toolathlon Authors Record for Gemini 3.5 Flash on Toolathlon Verified Vals Index 2.1 Effort: High 44.8% vals.ai for Gemini 3.5 Flash (high) on Vals Index 2.1 (opens in a new tab) Archived copy (opens in a new tab) Vals Index GDP-weighted Accuracy Reported October 6, 2026 Benchmark leaderboard Vals AI Independent Record for Gemini 3.5 Flash on Vals Index 2.1 Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation Effort: High Configuration: OpenHands harness 48.7% vals.ai for Gemini 3.5 Flash (high) on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab) Archived copy (opens in a new tab) Vibe Code Bench Score Reported October 6, 2026 Benchmark leaderboard Vals AI Independent Record for Gemini 3.5 Flash on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation