Claude Opus 4.7 vs Claude Opus 4.8
39 shared benchmark contexts with reported scores and primary source links.
Claude Opus 4.7Claude Opus 4.8
Change models in the comparison toolShared benchmarks
39| Benchmark | Claude Opus 4.7 | Claude Opus 4.8 |
|---|---|---|
|
| |
Evaluation details for APEX-Agents OriginalThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Opus 4.7 Claude Opus 4.8 | ||
|
| |
Evaluation details for AutomationBench 1.0.6The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Opus 4.7 | ||
|
| |
Evaluation details for BrowseComp 130-question subset — Mercor web research agentThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for Chartography October 2026 leaderboardThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for CharXiv Descriptive and reasoning — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for DeepSWE 1.1 — Mercor mini-swe-agent, 500 stepsThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for Finance Agent Benchmark 2 — October 2026 evaluationThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for GPQA DiamondThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for GPQA Diamond — Epoch AI harnessThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Opus 4.7 | ||
|
| |
Evaluation details for GPQA Diamond — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for GPQA Diamond — Vals AI harnessThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for HLAB October 2026 evaluationThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for Humanity's Last Exam Full set — No toolsThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for Humanity's Last Exam Full set — With toolsThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Opus 4.7 | ||
|
| |
Evaluation details for Humanity's Last Exam Text only — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Opus 4.7 | ||
|
| |
Evaluation details for MCP Atlas Public, April 2026 updateThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for MedXpertQA MM — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for MMLU-Pro Original — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for MMLU-Pro Original — Vals AI harnessThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for MMMU-Pro 1,730 questions — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for MMMU-Pro Vals AI harnessThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Opus 4.7 Claude Opus 4.8 | ||
|
| |
Evaluation details for PostTrainBench 1.1 — Claude CodeThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for PostTrainBench 1.2 — Claude CodeThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for Riemann-bench October 2026 leaderboardThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SimpleQA Verified Original — Epoch AI harnessThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 stepsThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SWE Atlas Codebase QnA — Public; Claude CodeThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SWE Atlas Refactoring — Claude CodeThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SWE-bench MultilingualThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Opus 4.7 Claude Opus 4.8 | ||
|
| |
Evaluation details for SWE-bench Multilingual — Mercor mini-swe-agent, 1000 stepsThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SWE-bench VerifiedThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Opus 4.7 Claude Opus 4.8 | ||
|
| |
Evaluation details for SWE-bench Verified — Mercor mini-swe-agent, 1000 stepsThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SWE-bench Verified — Vals AI mini-swe-agentThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SWE-bench Pro PublicThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Opus 4.7 Claude Opus 4.8 | ||
|
| |
Evaluation details for Terminal-Bench 2.0 — Vals AI Terminus 2The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for Terminal-Bench 2.1 — Vals AI Terminus 2The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
ToolathlonPotentially non-equivalent: Benchmark versions differ. |
|
|
Potentially non-equivalent · Evaluation details for ToolathlonBenchmark versions differ. Evaluation methodology is not recorded by the registry. Claude Opus 4.7 Claude Opus 4.8 | ||
|
| |
Evaluation details for Vibe Code Bench 1.1 — OpenHands, October 2026 evaluationThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 gradingThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||