Benchmarks

34 results across 16 benchmarks

Benchmark results for Claude Opus 4.6
BenchmarkScoreSource
APEX-Agents OriginalEffort: Max46.3%mercor.com for Claude Opus 4.6 (max) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for Claude Opus 4.6 on APEX-Agents Original
DeepSWE 1.1 — Mercor mini-swe-agent, 500 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 500 steps, 2 hours31.9%mercor.com for Claude Opus 4.6 (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for Claude Opus 4.6 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps
GPQA DiamondEffort: MaxReported as: adaptive thinking, max91.3%www-cdn.anthropic.com for Claude Opus 4.6 (adaptive thinking, max) on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Opus 4.6 on Graduate-Level Google-Proof Q&A Diamond
GPQA Diamond — Epoch AI harnessEffort: MaxConfiguration: Epoch AI harness88.4%epoch.ai for Claude Opus 4.6 (max) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Opus 4.6 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Vals AI harnessReported as: thinkingConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT89.6%vals.ai for Claude Opus 4.6 (thinking) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.6 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
Humanity's Last Exam Full set — No toolsEffort: MaxReported as: adaptive thinking, maxConfiguration: No tools40.0%www-cdn.anthropic.com for Claude Opus 4.6 (adaptive thinking, max) on Humanity's Last Exam Full set — No tools (opens in a new tab)Humanity's Last Exam AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Opus 4.6 on Humanity's Last Exam Full set — No tools
Humanity's Last Exam Full set — Scale AI evaluationEffort: NoneReported as: Non-Thinking19.0%labs.scale.com for Claude Opus 4.6 (Non-Thinking) on Humanity's Last Exam Full set — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.6 on Humanity's Last Exam Full set — Scale AI evaluation
Humanity's Last Exam Full set — Scale AI evaluationEffort: MaxReported as: thinking-max34.4%labs.scale.com for Claude Opus 4.6 (thinking-max) on Humanity's Last Exam Full set — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.6 on Humanity's Last Exam Full set — Scale AI evaluation
Humanity's Last Exam Full set — With toolsEffort: MaxReported as: adaptive thinking, maxConfiguration: With tools53.0%www-cdn.anthropic.com for Claude Opus 4.6 (adaptive thinking, max) on Humanity's Last Exam Full set — With tools (opens in a new tab)Humanity's Last Exam AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Opus 4.6 on Humanity's Last Exam Full set — With tools
Humanity's Last Exam Text only — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent35.0%mercor.com for Claude Opus 4.6 (max) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Opus 4.6 on Humanity's Last Exam Text only — Mercor single-shot
Humanity's Last Exam Text only — Scale AI evaluationEffort: NoneReported as: Non-Thinking19.4%labs.scale.com for Claude Opus 4.6 (Non-Thinking) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.6 on Humanity's Last Exam Text only — Scale AI evaluation
Humanity's Last Exam Text only — Scale AI evaluationEffort: MaxReported as: thinking-max36.2%labs.scale.com for Claude Opus 4.6 (thinking-max) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.6 on Humanity's Last Exam Text only — Scale AI evaluation
MCP Atlas Public, April 2026 updateEffort: Max76.8%labs.scale.com for Claude Opus 4.6 (max) on MCP Atlas Public, April 2026 update (opens in a new tab)Pass rateReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.6 on MCP Atlas Public, April 2026 update
MMLU-Pro Original — Vals AI harnessReported as: thinkingConfiguration: Vals AI harness89.1%vals.ai for Claude Opus 4.6 (thinking) on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.6 on MMLU-Pro Original — Vals AI harness
MMMU-Pro Vals AI harnessReported as: thinkingConfiguration: Vals AI harness83.9%vals.ai for Claude Opus 4.6 (thinking) on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.6 on MMMU-Pro Vals AI harness
OSWorld VerifiedEffort: MaxReported as: adaptive thinking, max72.7%www-cdn.anthropic.com for Claude Opus 4.6 (adaptive thinking, max) on OSWorld Verified (opens in a new tab)OSWorld-Verified success rateReported System cardAnthropicSelf-reportedRecord for Claude Opus 4.6 on OSWorld Verified
Riemann-bench October 2026 leaderboardEffort: MaxReported as: Adaptive/Max27.2%surgehq.ai for Claude Opus 4.6 (Adaptive/Max) on Riemann-bench October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Riemann-bench Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Claude Opus 4.6 on Riemann-bench October 2026 leaderboard
SimpleQA Verified Original — Epoch AI harnessEffort: MaxConfiguration: Epoch AI harness47.0%epoch.ai for Claude Opus 4.6 (max) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Opus 4.6 on SimpleQA Verified Original — Epoch AI harness
SWE Atlas Codebase QnA — Public; Claude CodeConfiguration: Claude Code harness33.3%labs.scale.com for Claude Opus 4.6 on SWE Atlas Codebase QnA — Public; Claude Code (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.6 on SWE Atlas Codebase QnA — Public; Claude Code
SWE Atlas Codebase QnA — Public; mini-swe-agentConfiguration: mini-swe-agent harness30.0%labs.scale.com for Claude Opus 4.6 on SWE Atlas Codebase QnA — Public; mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.6 on SWE Atlas Codebase QnA — Public; mini-swe-agent
SWE Atlas Refactoring — Claude CodeConfiguration: Claude Code harness35.6%labs.scale.com for Claude Opus 4.6 on SWE Atlas Refactoring — Claude Code (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.6 on SWE Atlas Refactoring — Claude Code
SWE-bench MultilingualEffort: MaxReported as: adaptive thinking, max77.8%www-cdn.anthropic.com for Claude Opus 4.6 (adaptive thinking, max) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Opus 4.6 on SWE-bench Multilingual
SWE-bench Multilingual — mini-swe-agentConfiguration: mini-swe-agent harness72.0%github.com for Claude Opus 4.6 on SWE-bench Multilingual — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark repositorySWE-benchIndependentSWE-bench TeamRecord for Claude Opus 4.6 on SWE-bench Multilingual — mini-swe-agent
SWE-bench VerifiedEffort: MaxReported as: adaptive thinking, max80.8%www-cdn.anthropic.com for Claude Opus 4.6 (adaptive thinking, max) on SWE-bench Verified (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Opus 4.6 on SWE-bench Verified
SWE-bench Verified — Epoch AI harnessConfiguration: Epoch AI harness75.6%epoch.ai for Claude Opus 4.6 on SWE-bench Verified — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Opus 4.6 on SWE-bench Verified — Epoch AI harness
SWE-bench Verified — mini-swe-agentConfiguration: mini-swe-agent harness75.6%github.com for Claude Opus 4.6 on SWE-bench Verified — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark repositorySWE-benchIndependentSWE-bench TeamRecord for Claude Opus 4.6 on SWE-bench Verified — mini-swe-agent
SWE-bench Verified — Vals AI mini-swe-agentReported as: thinkingConfiguration: mini-swe-agent harness78.2%vals.ai for Claude Opus 4.6 (thinking) on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.6 on SWE-bench Verified — Vals AI mini-swe-agent
SWE-bench Pro Private — Scale AI mini-swe-agentReported as: thinkingConfiguration: mini-swe-agent harness47.1%labs.scale.com for Claude Opus 4.6 (thinking) on SWE-bench Pro Private — Scale AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Public tasks resolvedReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.6 on SWE-bench Pro Private — Scale AI mini-swe-agent
SWE-bench Pro Public — Scale AI mini-swe-agentReported as: thinkingConfiguration: mini-swe-agent harness51.9%labs.scale.com for Claude Opus 4.6 (thinking) on SWE-bench Pro Public — Scale AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Public tasks resolvedReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.6 on SWE-bench Pro Public — Scale AI mini-swe-agent
Terminal-Bench 2.0Effort: MaxReported as: adaptive thinking, max65.4%www-cdn.anthropic.com for Claude Opus 4.6 (adaptive thinking, max) on Terminal-Bench 2.0 (opens in a new tab)Terminal-Bench AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Opus 4.6 on Terminal-Bench 2.0
Terminal-Bench 2.0 — Vals AI Terminus 2Reported as: thinkingConfiguration: Terminus-2 harness58.4%vals.ai for Claude Opus 4.6 (thinking) on Terminal-Bench 2.0 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.6 on Terminal-Bench 2.0 — Vals AI Terminus 2
Vibe Code Bench 1.1 — OpenHands, October 2026 evaluationConfiguration: OpenHands harness57.6%vals.ai for Claude Opus 4.6 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.6 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation
Vibe Code Bench 1.1 — OpenHands, October 2026 evaluationReported as: thinkingConfiguration: OpenHands harness53.5%vals.ai for Claude Opus 4.6 (thinking) on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.6 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation
τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 gradingEffort: MaxConfiguration: AllTools retrieval27.3%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Claude Opus 4.6 (max) on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Claude Opus 4.6 on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading