Shared benchmarks

8
Shared benchmarks for GPT-5 mini and GPT-5.4 mini
BenchmarkGPT-5 miniGPT-5.4 mini
  • 71.7%medium
  • 75.0%high
  • 64.1%none
  • 83.6%high
  • 86.9%xhigh
Evaluation details for GPQA Diamond — Epoch AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-5 mini

Record for GPT-5 mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
Record for GPT-5 mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness

GPT-5.4 mini

Record for GPT-5.4 mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
Record for GPT-5.4 mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
Record for GPT-5.4 mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
  • 80.3%
  • 83.1%
Evaluation details for GPQA Diamond — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-5 mini

Record for GPT-5 mini on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness

GPT-5.4 mini

Record for GPT-5.4 mini on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
  • 82.2%
  • 84.6%
Evaluation details for MMLU-Pro Original — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-5 mini

Record for GPT-5 mini on MMLU-Pro Original — Vals AI harness

GPT-5.4 mini

  • 78.9%
  • 79.2%
Evaluation details for MMMU-Pro Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-5 mini

Record for GPT-5 mini on MMMU-Pro Vals AI harness

GPT-5.4 mini

Record for GPT-5.4 mini on MMMU-Pro Vals AI harness
  • 21.6%
  • 29.4%
Evaluation details for SimpleQA Verified Original — Epoch AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

  • 60.8%
  • 73.0%
Evaluation details for SWE-bench Verified — Vals AI mini-swe-agent

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-5 mini

GPT-5.4 mini

  • 27.0%
  • 44.9%
Evaluation details for Terminal-Bench 2.0 — Vals AI Terminus 2

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-5 mini

Record for GPT-5 mini on Terminal-Bench 2.0 — Vals AI Terminus 2

GPT-5.4 mini

Record for GPT-5.4 mini on Terminal-Bench 2.0 — Vals AI Terminus 2
  • 14.2%
  • 48.0%
Evaluation details for Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.