Shared benchmarks

11
Shared benchmarks for GPT-4.1 and GPT-5
BenchmarkGPT-4.1GPT-5
  • 66.9%
  • 85.4%medium
  • 86.2%high
Evaluation details for GPQA Diamond — Epoch AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-4.1

Record for GPT-4.1 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness

GPT-5

Record for GPT-5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
Record for GPT-5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
  • 65.4%
  • 85.6%
Evaluation details for GPQA Diamond — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-4.1

Record for GPT-4.1 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness

GPT-5

Record for GPT-5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
  • 5.4%
  • 25.3%
Evaluation details for Humanity's Last Exam Full set — Scale AI evaluation

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-4.1

GPT-5

Record for GPT-5 on Humanity's Last Exam Full set — Scale AI evaluation
  • 5.0%
  • 26.3%
Evaluation details for Humanity's Last Exam Text only — Scale AI evaluation

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-4.1

GPT-5

Record for GPT-5 on Humanity's Last Exam Text only — Scale AI evaluation
  • 80.5%
  • 86.5%
Evaluation details for MMLU-Pro Original — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-4.1

Record for GPT-4.1 on MMLU-Pro Original — Vals AI harness

GPT-5

Record for GPT-5 on MMLU-Pro Original — Vals AI harness
  • 72.4%
  • 81.5%
Evaluation details for MMMU-Pro Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-4.1

Record for GPT-4.1 on MMMU-Pro Vals AI harness

GPT-5

Record for GPT-5 on MMMU-Pro Vals AI harness
  • 31.1%
  • 50.1%
Evaluation details for SimpleQA Verified Original — Epoch AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

  • 48.5%
  • 71.5%medium
  • 73.6%high
Evaluation details for SWE-bench Verified — Epoch AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-4.1

Record for GPT-4.1 on SWE-bench Verified — Epoch AI harness

GPT-5

Record for GPT-5 on SWE-bench Verified — Epoch AI harness
Record for GPT-5 on SWE-bench Verified — Epoch AI harness
  • 39.6%
  • 65.0%
Evaluation details for SWE-bench Verified — mini-swe-agent

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-4.1

Record for GPT-4.1 on SWE-bench Verified — mini-swe-agent

GPT-5

Record for GPT-5 on SWE-bench Verified — mini-swe-agent
SWE-benchPotentially non-equivalent: Benchmark versions differ. Evaluator sets differ.
  • 54.6%Verified · OpenAI
  • 69.0%Verified — Vals AI mini-swe-agent · Vals AI
Potentially non-equivalent · Evaluation details for SWE-bench

Benchmark versions differ. Evaluator sets differ. Evaluation methodology is not recorded by the registry.

GPT-4.1

Record for GPT-4.1 on SWE-bench Verified

GPT-5

Record for GPT-5 on SWE-bench Verified — Vals AI mini-swe-agent
  • 14.6%
  • 37.1%
Evaluation details for Terminal-Bench 2.0 — Vals AI Terminus 2

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-4.1

Record for GPT-4.1 on Terminal-Bench 2.0 — Vals AI Terminus 2

GPT-5

Record for GPT-5 on Terminal-Bench 2.0 — Vals AI Terminus 2