Shared benchmarks

8
Shared benchmarks for Claude Opus 4.1 and Claude Opus 4.5
BenchmarkClaude Opus 4.1Claude Opus 4.5
  • 73.2%
  • 80.7%
Evaluation details for GPQA Diamond — Epoch AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.1

Record for Claude Opus 4.1 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness

Claude Opus 4.5

Record for Claude Opus 4.5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
  • 70.0%
  • 76.3%thinking
  • 79.5%
  • 85.9%thinking
Evaluation details for GPQA Diamond — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.1

Record for Claude Opus 4.1 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
Record for Claude Opus 4.1 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness

Claude Opus 4.5

Record for Claude Opus 4.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
Record for Claude Opus 4.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
  • 7.9%
  • 11.5%thinking
  • 14.2%
  • 25.2%thinking
Evaluation details for Humanity's Last Exam Full set — Scale AI evaluation

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

  • 7.4%
  • 11.3%thinking
  • 13.9%
  • 26.3%thinking
Evaluation details for Humanity's Last Exam Text only — Scale AI evaluation

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

  • 87.2%
  • 87.9%thinking
  • 85.6%
  • 87.3%thinking
Evaluation details for MMLU-Pro Original — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.1

Record for Claude Opus 4.1 on MMLU-Pro Original — Vals AI harness

Claude Opus 4.5

Record for Claude Opus 4.5 on MMLU-Pro Original — Vals AI harness
  • 73.7%
  • 77.5%thinking
  • 81.1%
  • 82.9%thinking
Evaluation details for MMMU-Pro Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.1

Record for Claude Opus 4.1 on MMMU-Pro Vals AI harness
Record for Claude Opus 4.1 on MMMU-Pro Vals AI harness

Claude Opus 4.5

Record for Claude Opus 4.5 on MMMU-Pro Vals AI harness
Record for Claude Opus 4.5 on MMMU-Pro Vals AI harness
  • 73.3%
  • 76.7%
Evaluation details for SWE-bench Verified — Epoch AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.1

Record for Claude Opus 4.1 on SWE-bench Verified — Epoch AI harness

Claude Opus 4.5

Record for Claude Opus 4.5 on SWE-bench Verified — Epoch AI harness
  • 17.8%
  • 23.4%
Evaluation details for SWE-bench Pro Private — Scale AI SWE-Agent

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.1

Record for Claude Opus 4.1 on SWE-bench Pro Private — Scale AI SWE-Agent

Claude Opus 4.5

Record for Claude Opus 4.5 on SWE-bench Pro Private — Scale AI SWE-Agent