Shared benchmarks

5
Shared benchmarks for Gemini 2.5 Flash and Gemini 3 Flash
BenchmarkGemini 2.5 FlashGemini 3 Flash
  • 82.8%
  • 90.4%
Evaluation details for GPQA Diamond

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Gemini 2.5 Flash

Record for Gemini 2.5 Flash on Graduate-Level Google-Proof Q&A Diamond

Gemini 3 Flash

Record for Gemini 3 Flash on Graduate-Level Google-Proof Q&A Diamond
  • 57.6%
  • 87.9%
Evaluation details for GPQA Diamond — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Gemini 2.5 Flash

Record for Gemini 2.5 Flash on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness

Gemini 3 Flash

Record for Gemini 3 Flash on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
  • 68.0%
  • 71.9%thinking
  • 87.6%
Evaluation details for MMMU-Pro Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Gemini 2.5 Flash

Record for Gemini 2.5 Flash on MMMU-Pro Vals AI harness
Record for Gemini 2.5 Flash on MMMU-Pro Vals AI harness

Gemini 3 Flash

Record for Gemini 3 Flash on MMMU-Pro Vals AI harness
  • 48.9%
  • 78.0%
Evaluation details for SWE-bench Verified

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Gemini 2.5 Flash

Record for Gemini 2.5 Flash on SWE-bench Verified

Gemini 3 Flash

Record for Gemini 3 Flash on SWE-bench Verified
  • 28.7%
  • 75.8%
Evaluation details for SWE-bench Verified — mini-swe-agent

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Gemini 2.5 Flash

Record for Gemini 2.5 Flash on SWE-bench Verified — mini-swe-agent

Gemini 3 Flash

Record for Gemini 3 Flash on SWE-bench Verified — mini-swe-agent