Shared benchmarks

5
Shared benchmarks for GPT-4.1 nano and GPT-5 nano
BenchmarkGPT-4.1 nanoGPT-5 nano
  • 48.9%
  • 57.6%low
  • 67.4%medium
  • 69.4%high
Evaluation details for GPQA Diamond — Epoch AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-4.1 nano

Record for GPT-4.1 nano on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness

GPT-5 nano

Record for GPT-5 nano on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
Record for GPT-5 nano on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
Record for GPT-5 nano on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
  • 50.8%
  • 63.4%
Evaluation details for GPQA Diamond — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-4.1 nano

Record for GPT-4.1 nano on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness

GPT-5 nano

Record for GPT-5 nano on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
  • 63.5%
  • 76.1%
Evaluation details for MMLU-Pro Original — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-4.1 nano

GPT-5 nano

Record for GPT-5 nano on MMLU-Pro Original — Vals AI harness
  • 55.1%
  • 70.9%
Evaluation details for MMMU-Pro Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GPT-4.1 nano

Record for GPT-4.1 nano on MMMU-Pro Vals AI harness

GPT-5 nano

Record for GPT-5 nano on MMMU-Pro Vals AI harness
  • 6.0%
  • 11.7%
Evaluation details for SimpleQA Verified Original — Epoch AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.