Shared benchmarks

6
Shared benchmarks for GPT-4.1 mini and GPT-5 mini
BenchmarkGPT-4.1 miniGPT-5 mini
  • 65.8%
  • 71.7%medium
  • 75.0%high
Evaluation details for GPQA Diamond — Epoch AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-4.1 mini

Record for GPT-4.1 mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness

GPT-5 mini

Record for GPT-5 mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
Record for GPT-5 mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
  • 67.9%
  • 80.3%
Evaluation details for GPQA Diamond — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-4.1 mini

Record for GPT-4.1 mini on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness

GPT-5 mini

Record for GPT-5 mini on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
  • 77.2%
  • 82.2%
Evaluation details for MMLU-Pro Original — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-4.1 mini

GPT-5 mini

Record for GPT-5 mini on MMLU-Pro Original — Vals AI harness
  • 70.5%
  • 78.9%
Evaluation details for MMMU-Pro Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-4.1 mini

Record for GPT-4.1 mini on MMMU-Pro Vals AI harness

GPT-5 mini

Record for GPT-5 mini on MMMU-Pro Vals AI harness
  • 12.7%
  • 21.6%
Evaluation details for SimpleQA Verified Original — Epoch AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

  • 23.9%
  • 59.8%medium
  • 56.2%
Evaluation details for SWE-bench Verified — mini-swe-agent

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-4.1 mini

Record for GPT-4.1 mini on SWE-bench Verified — mini-swe-agent

GPT-5 mini

Record for GPT-5 mini on SWE-bench Verified — mini-swe-agent
Record for GPT-5 mini on SWE-bench Verified — mini-swe-agent