Claude Opus 4.8 vs Claude Opus 5
36 shared benchmark contexts with reported scores and primary source links.
Change models in the comparison toolShared benchmarks
36| Benchmark | Claude Opus 4.8 | Claude Opus 5 |
|---|---|---|
|
| |
Evaluation details for APEX-Agents OriginalThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Opus 4.8 Claude Opus 5 | ||
|
| |
Evaluation details for AutomationBench 1.0.6The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Opus 4.8 | ||
|
| |
Evaluation details for BrowseComp 130-question subset — Mercor web research agentThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for Chartography October 2026 leaderboardThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for CharXiv Descriptive and reasoning — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
DeepSWE 1.1Potentially non-equivalent: Evaluator sets differ. |
|
|
Potentially non-equivalent · Evaluation details for DeepSWE 1.1Evaluator sets differ. Evaluation methodology is not recorded by the registry. Claude Opus 4.8 | ||
|
| |
Evaluation details for DeepSWE 1.1 — Mercor mini-swe-agent, 500 stepsThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for Finance Agent Benchmark 2 — October 2026 evaluationThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for GPQA Diamond — Epoch AI harnessThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Opus 4.8 | ||
|
| |
Evaluation details for GPQA Diamond — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for GPQA Diamond — Vals AI harnessThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for HLAB October 2026 evaluationThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for Humanity's Last Exam Full set — No toolsThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Opus 5 | ||
|
| |
Evaluation details for Humanity's Last Exam Full set — With toolsThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Opus 5 | ||
|
| |
Evaluation details for Humanity's Last Exam Text only — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Opus 4.8 | ||
|
| |
Evaluation details for MCP Atlas Public, April 2026 updateThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for MedXpertQA MM — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for MMLU-Pro Original — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for MMLU-Pro Original — Vals AI harnessThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for MMMU-Pro 1,730 questions — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for MMMU-Pro Vals AI harnessThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Opus 4.8 Claude Opus 5 | ||
|
| |
Evaluation details for PostTrainBench 1.1 — Claude CodeThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for PostTrainBench 1.2 — Claude CodeThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for Riemann-bench October 2026 leaderboardThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SimpleQA Verified Original — Epoch AI harnessThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 stepsThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SWE Atlas Codebase QnA — Public; Claude CodeThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SWE-bench MultilingualThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Opus 4.8 Claude Opus 5 | ||
|
| |
Evaluation details for SWE-bench Multilingual — Mercor mini-swe-agent, 1000 stepsThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SWE-bench VerifiedThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Opus 4.8 Claude Opus 5 | ||
|
| |
Evaluation details for SWE-bench Verified — Mercor mini-swe-agent, 1000 stepsThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SWE-bench Verified — Vals AI mini-swe-agentThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for Terminal-Bench 4.0 — Claude CodeThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Opus 5 | ||
|
| |
Evaluation details for Vals Index 2.1The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Opus 4.8 Claude Opus 5 | ||
|
| |
Evaluation details for Vibe Code Bench 1.1 — OpenHands, October 2026 evaluationThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 gradingThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||