Shared benchmarks

39
Shared benchmarks for Claude Opus 4.7 and Claude Opus 4.8
BenchmarkClaude Opus 4.7Claude Opus 4.8
  • 49.2%
  • 48.9%
Evaluation details for APEX-Agents Original

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Record for Claude Opus 4.7 on APEX-Agents Original

Claude Opus 4.8

Record for Claude Opus 4.8 on APEX-Agents Original
  • 5.5%low
  • 6.9%medium
  • 9.1%high
  • 9.7%xhigh
  • 13.4%max
  • 13.6%low
  • 14.0%medium
  • 16.1%high
  • 16.9%xhigh
  • 16.4%max
Evaluation details for AutomationBench 1.0.6

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Record for Claude Opus 4.7 on AutomationBench 1.0.6
Record for Claude Opus 4.7 on AutomationBench 1.0.6
Record for Claude Opus 4.7 on AutomationBench 1.0.6
Record for Claude Opus 4.7 on AutomationBench 1.0.6
Record for Claude Opus 4.7 on AutomationBench 1.0.6

Claude Opus 4.8

Record for Claude Opus 4.8 on AutomationBench 1.0.6
Record for Claude Opus 4.8 on AutomationBench 1.0.6
Record for Claude Opus 4.8 on AutomationBench 1.0.6
Record for Claude Opus 4.8 on AutomationBench 1.0.6
Record for Claude Opus 4.8 on AutomationBench 1.0.6
  • 60.6%
  • 73.7%
Evaluation details for BrowseComp 130-question subset — Mercor web research agent

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

  • 16.5%
  • 15.9%
Evaluation details for Chartography October 2026 leaderboard

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Record for Claude Opus 4.7 on Chartography October 2026 leaderboard

Claude Opus 4.8

Record for Claude Opus 4.8 on Chartography October 2026 leaderboard
  • 92.6%
  • 93.2%
Evaluation details for CharXiv Descriptive and reasoning — Mercor single-shot

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

  • 49.3%
  • 59.6%
Evaluation details for DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Claude Opus 4.8

  • 51.5%
  • 53.9%
Evaluation details for Finance Agent Benchmark 2 — October 2026 evaluation

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

  • 94.2%
  • 93.6%
Evaluation details for GPQA Diamond

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Record for Claude Opus 4.7 on Graduate-Level Google-Proof Q&A Diamond

Claude Opus 4.8

Record for Claude Opus 4.8 on Graduate-Level Google-Proof Q&A Diamond
  • 90.2%xhigh
  • 86.4%max
  • 85.4%none
  • 88.4%low
  • 91.0%max
Evaluation details for GPQA Diamond — Epoch AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Claude Opus 4.8

  • 86.4%
  • 92.0%
Evaluation details for GPQA Diamond — Mercor single-shot

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Claude Opus 4.8

  • 90.2%
  • 92.4%
Evaluation details for GPQA Diamond — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Record for Claude Opus 4.7 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness

Claude Opus 4.8

Record for Claude Opus 4.8 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
  • 6.7%
  • 9.6%
Evaluation details for HLAB October 2026 evaluation

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Record for Claude Opus 4.7 on Harvey's Legal Agent Benchmark October 2026 evaluation

Claude Opus 4.8

Record for Claude Opus 4.8 on Harvey's Legal Agent Benchmark October 2026 evaluation
  • 46.9%
  • 49.8%
Evaluation details for Humanity's Last Exam Full set — No tools

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Record for Claude Opus 4.7 on Humanity's Last Exam Full set — No tools

Claude Opus 4.8

Record for Claude Opus 4.8 on Humanity's Last Exam Full set — No tools
  • 43.0%adaptive thinking, low
  • 48.4%adaptive thinking, medium
  • 53.2%adaptive thinking, high
  • 55.4%adaptive thinking, xhigh
  • 54.7%adaptive thinking, max
  • 57.9%
Evaluation details for Humanity's Last Exam Full set — With tools

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Record for Claude Opus 4.7 on Humanity's Last Exam Full set — With tools
Record for Claude Opus 4.7 on Humanity's Last Exam Full set — With tools
Record for Claude Opus 4.7 on Humanity's Last Exam Full set — With tools
Record for Claude Opus 4.7 on Humanity's Last Exam Full set — With tools
Record for Claude Opus 4.7 on Humanity's Last Exam Full set — With tools

Claude Opus 4.8

Record for Claude Opus 4.8 on Humanity's Last Exam Full set — With tools
  • 42.2%high
  • 35.4%max
  • 44.8%high
  • 37.1%max
Evaluation details for Humanity's Last Exam Text only — Mercor single-shot

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

  • 79.1%
  • 82.2%
Evaluation details for MCP Atlas Public, April 2026 update

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Claude Opus 4.8

  • 72.8%
  • 72.5%
Evaluation details for MedXpertQA MM — Mercor single-shot

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Record for Claude Opus 4.7 on MedXpertQA MM — Mercor single-shot

Claude Opus 4.8

Record for Claude Opus 4.8 on MedXpertQA MM — Mercor single-shot
  • 89.9%
  • 90.0%
Evaluation details for MMLU-Pro Original — Mercor single-shot

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Claude Opus 4.8

  • 89.9%
  • 89.6%
Evaluation details for MMLU-Pro Original — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Record for Claude Opus 4.7 on MMLU-Pro Original — Vals AI harness

Claude Opus 4.8

Record for Claude Opus 4.8 on MMLU-Pro Original — Vals AI harness
  • 78.6%
  • 79.5%
Evaluation details for MMMU-Pro 1,730 questions — Mercor single-shot

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Record for Claude Opus 4.7 on MMMU-Pro 1,730 questions — Mercor single-shot

Claude Opus 4.8

Record for Claude Opus 4.8 on MMMU-Pro 1,730 questions — Mercor single-shot
  • 85.5%
  • 86.6%
Evaluation details for MMMU-Pro Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Record for Claude Opus 4.7 on MMMU-Pro Vals AI harness

Claude Opus 4.8

Record for Claude Opus 4.8 on MMMU-Pro Vals AI harness
  • 28.6%
  • 33.8%High
  • 32.9%Max
Evaluation details for PostTrainBench 1.1 — Claude Code

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Record for Claude Opus 4.7 on PostTrainBench 1.1 — Claude Code

Claude Opus 4.8

Record for Claude Opus 4.8 on PostTrainBench 1.1 — Claude Code
Record for Claude Opus 4.8 on PostTrainBench 1.1 — Claude Code
  • 24.3%
  • 30.7%High
  • 31.0%Max
Evaluation details for PostTrainBench 1.2 — Claude Code

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Record for Claude Opus 4.7 on PostTrainBench 1.2 — Claude Code

Claude Opus 4.8

Record for Claude Opus 4.8 on PostTrainBench 1.2 — Claude Code
Record for Claude Opus 4.8 on PostTrainBench 1.2 — Claude Code
  • 32.8%
  • 47.2%
Evaluation details for Riemann-bench October 2026 leaderboard

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Record for Claude Opus 4.7 on Riemann-bench October 2026 leaderboard

Claude Opus 4.8

Record for Claude Opus 4.8 on Riemann-bench October 2026 leaderboard
  • 51.7%
  • 53.0%
Evaluation details for SimpleQA Verified Original — Epoch AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

  • 47.0%
  • 44.4%
Evaluation details for SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

  • 40.3%
  • 57.3%
Evaluation details for SWE Atlas Codebase QnA — Public; Claude Code

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

  • 48.6%
  • 46.7%
Evaluation details for SWE Atlas Refactoring — Claude Code

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Record for Claude Opus 4.7 on SWE Atlas Refactoring — Claude Code

Claude Opus 4.8

Record for Claude Opus 4.8 on SWE Atlas Refactoring — Claude Code
  • 80.5%
  • 84.4%
Evaluation details for SWE-bench Multilingual

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Record for Claude Opus 4.7 on SWE-bench Multilingual

Claude Opus 4.8

Record for Claude Opus 4.8 on SWE-bench Multilingual
  • 85.3%
  • 86.6%
Evaluation details for SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

  • 87.6%
  • 88.6%
Evaluation details for SWE-bench Verified

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Record for Claude Opus 4.7 on SWE-bench Verified

Claude Opus 4.8

Record for Claude Opus 4.8 on SWE-bench Verified
  • 83.1%
  • 88.5%
Evaluation details for SWE-bench Verified — Mercor mini-swe-agent, 1000 steps

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

  • 82.0%
  • 88.6%
Evaluation details for SWE-bench Verified — Vals AI mini-swe-agent

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Claude Opus 4.8

  • 64.3%
  • 69.2%
Evaluation details for SWE-bench Pro Public

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Record for Claude Opus 4.7 on SWE-bench Pro Public

Claude Opus 4.8

Record for Claude Opus 4.8 on SWE-bench Pro Public
  • 68.5%
  • 70.0%
Evaluation details for Terminal-Bench 2.0 — Vals AI Terminus 2

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Record for Claude Opus 4.7 on Terminal-Bench 2.0 — Vals AI Terminus 2

Claude Opus 4.8

Record for Claude Opus 4.8 on Terminal-Bench 2.0 — Vals AI Terminus 2
  • 68.5%
  • 71.9%
Evaluation details for Terminal-Bench 2.1 — Vals AI Terminus 2

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Record for Claude Opus 4.7 on Terminal-Bench 2.1 — Vals AI Terminus 2

Claude Opus 4.8

Record for Claude Opus 4.8 on Terminal-Bench 2.1 — Vals AI Terminus 2
ToolathlonPotentially non-equivalent: Benchmark versions differ.
  • 52.8%Original · Toolathlon Authors
  • 76.2%Verified · Toolathlon Authors
Potentially non-equivalent · Evaluation details for Toolathlon

Benchmark versions differ. Evaluation methodology is not recorded by the registry.

Claude Opus 4.7

Record for Claude Opus 4.7 on Toolathlon Original

Claude Opus 4.8

Record for Claude Opus 4.8 on Toolathlon Verified
  • 71.0%
  • 82.7%
Evaluation details for Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

  • 40.2%
  • 39.7%
Evaluation details for τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.