Benchmarks

33 results across 13 benchmarks

Benchmark results for Claude Opus 4.5
BenchmarkScoreSource
GPQA DiamondReported as: extended thinking87.0%assets.anthropic.com for Claude Opus 4.5 (extended thinking) on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Opus 4.5 on Graduate-Level Google-Proof Q&A Diamond
GPQA Diamond — Epoch AI harnessConfiguration: Epoch AI harness80.7%epoch.ai for Claude Opus 4.5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Opus 4.5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Vals AI harnessConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT79.5%vals.ai for Claude Opus 4.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
GPQA Diamond — Vals AI harnessReported as: thinkingConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT85.9%vals.ai for Claude Opus 4.5 (thinking) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
Humanity's Last Exam Full set — No toolsReported as: extended thinkingConfiguration: No tools30.8%assets.anthropic.com for Claude Opus 4.5 (extended thinking) on Humanity's Last Exam Full set — No tools (opens in a new tab)Humanity's Last Exam AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Opus 4.5 on Humanity's Last Exam Full set — No tools
Humanity's Last Exam Full set — Scale AI evaluation14.2%labs.scale.com for Claude Opus 4.5 on Humanity's Last Exam Full set — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.5 on Humanity's Last Exam Full set — Scale AI evaluation
Humanity's Last Exam Full set — Scale AI evaluationReported as: thinking25.2%labs.scale.com for Claude Opus 4.5 (thinking) on Humanity's Last Exam Full set — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.5 on Humanity's Last Exam Full set — Scale AI evaluation
Humanity's Last Exam Text only — Scale AI evaluation13.9%labs.scale.com for Claude Opus 4.5 on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.5 on Humanity's Last Exam Text only — Scale AI evaluation
Humanity's Last Exam Text only — Scale AI evaluationReported as: thinking26.3%labs.scale.com for Claude Opus 4.5 (thinking) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.5 on Humanity's Last Exam Text only — Scale AI evaluation
MCP Atlas Public, April 2026 updateEffort: High69.8%labs.scale.com for Claude Opus 4.5 (high) on MCP Atlas Public, April 2026 update (opens in a new tab)Pass rateReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.5 on MCP Atlas Public, April 2026 update
MMLU-Pro Original — Vals AI harnessConfiguration: Vals AI harness85.6%vals.ai for Claude Opus 4.5 on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.5 on MMLU-Pro Original — Vals AI harness
MMLU-Pro Original — Vals AI harnessReported as: thinkingConfiguration: Vals AI harness87.3%vals.ai for Claude Opus 4.5 (thinking) on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.5 on MMLU-Pro Original — Vals AI harness
MMMU-Pro Vals AI harnessConfiguration: Vals AI harness81.1%vals.ai for Claude Opus 4.5 on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.5 on MMMU-Pro Vals AI harness
MMMU-Pro Vals AI harnessReported as: thinkingConfiguration: Vals AI harness82.9%vals.ai for Claude Opus 4.5 (thinking) on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.5 on MMMU-Pro Vals AI harness
OSWorld VerifiedReported as: extended thinking66.3%assets.anthropic.com for Claude Opus 4.5 (extended thinking) on OSWorld Verified (opens in a new tab)OSWorld-Verified success rateReported System cardAnthropicSelf-reportedRecord for Claude Opus 4.5 on OSWorld Verified
Riemann-bench October 2026 leaderboardEffort: MaxReported as: Adaptive/Max11.2%surgehq.ai for Claude Opus 4.5 (Adaptive/Max) on Riemann-bench October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Riemann-bench Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Claude Opus 4.5 on Riemann-bench October 2026 leaderboard
SWE-bench Multilingual — mini-swe-agentConfiguration: mini-swe-agent harness70.7%github.com for Claude Opus 4.5 on SWE-bench Multilingual — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark repositorySWE-benchIndependentSWE-bench TeamRecord for Claude Opus 4.5 on SWE-bench Multilingual — mini-swe-agent
SWE-bench VerifiedEffort: NoneReported as: no thinking80.9%assets.anthropic.com for Claude Opus 4.5 (no thinking) on SWE-bench Verified (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Opus 4.5 on SWE-bench Verified
SWE-bench Verified — Epoch AI harnessConfiguration: Epoch AI harness76.7%epoch.ai for Claude Opus 4.5 on SWE-bench Verified — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Opus 4.5 on SWE-bench Verified — Epoch AI harness
SWE-bench Verified — mini-swe-agentEffort: MediumConfiguration: mini-swe-agent harness74.4%github.com for Claude Opus 4.5 (medium) on SWE-bench Verified — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark repositorySWE-benchIndependentSWE-bench TeamRecord for Claude Opus 4.5 on SWE-bench Verified — mini-swe-agent
SWE-bench Verified — mini-swe-agentEffort: HighConfiguration: mini-swe-agent harness76.8%github.com for Claude Opus 4.5 (high) on SWE-bench Verified — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark repositorySWE-benchIndependentSWE-bench TeamRecord for Claude Opus 4.5 on SWE-bench Verified — mini-swe-agent
SWE-bench Verified — Vals AI mini-swe-agentReported as: thinkingConfiguration: mini-swe-agent harness76.4%vals.ai for Claude Opus 4.5 (thinking) on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.5 on SWE-bench Verified — Vals AI mini-swe-agent
SWE-bench Pro Private — Scale AI SWE-AgentConfiguration: SWE-Agent harness, 250 turns, uncapped cost23.4%labs.scale.com for Claude Opus 4.5 on SWE-bench Pro Private — Scale AI SWE-Agent (opens in a new tab)Archived copy (opens in a new tab)Public tasks resolvedReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.5 on SWE-bench Pro Private — Scale AI SWE-Agent
SWE-bench Pro Public — Scale AI SWE-AgentConfiguration: SWE-Agent harness, 250 turns, uncapped cost45.9%labs.scale.com for Claude Opus 4.5 on SWE-bench Pro Public — Scale AI SWE-Agent (opens in a new tab)Archived copy (opens in a new tab)Public tasks resolvedReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.5 on SWE-bench Pro Public — Scale AI SWE-Agent
Terminal-Bench 2.0Reported as: extended thinking (128K)59.8%assets.anthropic.com for Claude Opus 4.5 (extended thinking (128K)) on Terminal-Bench 2.0 (opens in a new tab)Terminal-Bench AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Opus 4.5 on Terminal-Bench 2.0
Terminal-Bench 2.0 — Vals AI Terminus 2Configuration: Terminus-2 harness58.4%vals.ai for Claude Opus 4.5 on Terminal-Bench 2.0 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.5 on Terminal-Bench 2.0 — Vals AI Terminus 2
Terminal-Bench 2.0 — Vals AI Terminus 2Reported as: thinkingConfiguration: Terminus-2 harness53.9%vals.ai for Claude Opus 4.5 (thinking) on Terminal-Bench 2.0 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.5 on Terminal-Bench 2.0 — Vals AI Terminus 2
Toolathlon Original43.5%toolathlon.xyz for Claude Opus 4.5 on Toolathlon Original (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for Claude Opus 4.5 on Toolathlon Original
Vibe Code Bench 1.1 — OpenHands, October 2026 evaluationReported as: thinkingConfiguration: OpenHands harness20.6%vals.ai for Claude Opus 4.5 (thinking) on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.5 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation
τ³-bench τ³ — AirlineEffort: High84.0%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Claude Opus 4.5 (high) on τ³-bench τ³ — Airline (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Claude Opus 4.5 on τ³-bench τ³ — Airline
τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 gradingEffort: HighConfiguration: AllTools retrieval24.7%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Claude Opus 4.5 (high) on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Claude Opus 4.5 on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading
τ³-bench τ³ — RetailEffort: High79.6%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Claude Opus 4.5 (high) on τ³-bench τ³ — Retail (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Claude Opus 4.5 on τ³-bench τ³ — Retail
τ³-bench τ³ — TelecomEffort: High92.3%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Claude Opus 4.5 (high) on τ³-bench τ³ — Telecom (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Claude Opus 4.5 on τ³-bench τ³ — Telecom