Shared benchmarks

6
Shared benchmarks for GPT-5 nano and GPT-5.4 nano
BenchmarkGPT-5 nanoGPT-5.4 nano
  • 57.6%low
  • 67.4%medium
  • 69.4%high
  • 55.6%none
  • 72.2%low
  • 78.5%high
Evaluation details for GPQA Diamond — Epoch AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-5 nano

Record for GPT-5 nano on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
Record for GPT-5 nano on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
Record for GPT-5 nano on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness

GPT-5.4 nano

Record for GPT-5.4 nano on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
Record for GPT-5.4 nano on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
  • 63.4%
  • 77.5%
Evaluation details for GPQA Diamond — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-5 nano

Record for GPT-5 nano on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness

GPT-5.4 nano

Record for GPT-5.4 nano on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
  • 76.1%
  • 77.2%
Evaluation details for MMLU-Pro Original — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-5 nano

Record for GPT-5 nano on MMLU-Pro Original — Vals AI harness

GPT-5.4 nano

  • 70.9%
  • 73.6%
Evaluation details for MMMU-Pro Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-5 nano

Record for GPT-5 nano on MMMU-Pro Vals AI harness

GPT-5.4 nano

Record for GPT-5.4 nano on MMMU-Pro Vals AI harness
  • 11.7%
  • 11.7%
Evaluation details for SimpleQA Verified Original — Epoch AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

SWE-benchPotentially non-equivalent: Benchmark versions differ. Evaluator sets differ.
  • 34.8%Verified — mini-swe-agent · SWE-bench Team
  • 69.8%Verified — Vals AI mini-swe-agent · Vals AI
Potentially non-equivalent · Evaluation details for SWE-bench

Benchmark versions differ. Evaluator sets differ. Evaluation methodology is not recorded by the registry.

GPT-5 nano

Record for GPT-5 nano on SWE-bench Verified — mini-swe-agent

GPT-5.4 nano