Shared benchmarks

9
Shared benchmarks for Gemini 2.5 Pro and Gemini 3 Pro
BenchmarkGemini 2.5 ProGemini 3 Pro
  • 86.4%
  • 91.9%
Evaluation details for GPQA Diamond

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Gemini 2.5 Pro

Record for Gemini 2.5 Pro on Graduate-Level Google-Proof Q&A Diamond

Gemini 3 Pro

Record for Gemini 3 Pro on Graduate-Level Google-Proof Q&A Diamond
  • 83.8%
  • 92.6%
Evaluation details for GPQA Diamond — Epoch AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Gemini 2.5 Pro

Record for Gemini 2.5 Pro on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness

Gemini 3 Pro

Record for Gemini 3 Pro on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
  • 80.8%
  • 91.7%
Evaluation details for GPQA Diamond — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Gemini 2.5 Pro

Record for Gemini 2.5 Pro on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness

Gemini 3 Pro

Record for Gemini 3 Pro on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
  • 18.2%
  • 37.5%
Evaluation details for Humanity's Last Exam Full set — Scale AI evaluation

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Gemini 2.5 Pro

Gemini 3 Pro

  • 18.4%
  • 37.7%
Evaluation details for Humanity's Last Exam Text only — Scale AI evaluation

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Gemini 2.5 Pro

Gemini 3 Pro

  • 84.1%
  • 90.1%
Evaluation details for MMLU-Pro Original — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Gemini 2.5 Pro

Record for Gemini 2.5 Pro on MMLU-Pro Original — Vals AI harness

Gemini 3 Pro

Record for Gemini 3 Pro on MMLU-Pro Original — Vals AI harness
  • 81.3%
  • 87.5%
Evaluation details for MMMU-Pro Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Gemini 2.5 Pro

Record for Gemini 2.5 Pro on MMMU-Pro Vals AI harness

Gemini 3 Pro

Record for Gemini 3 Pro on MMMU-Pro Vals AI harness
  • 59.6%
  • 76.2%
Evaluation details for SWE-bench Verified

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Gemini 2.5 Pro

Record for Gemini 2.5 Pro on SWE-bench Verified

Gemini 3 Pro

Record for Gemini 3 Pro on SWE-bench Verified
  • 53.6%
  • 69.6%high
  • 74.2%
Evaluation details for SWE-bench Verified — mini-swe-agent

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Gemini 2.5 Pro

Record for Gemini 2.5 Pro on SWE-bench Verified — mini-swe-agent

Gemini 3 Pro

Record for Gemini 3 Pro on SWE-bench Verified — mini-swe-agent
Record for Gemini 3 Pro on SWE-bench Verified — mini-swe-agent