Benchmarks

13 results across 6 benchmarks

Benchmark results for Claude Opus 4
BenchmarkScoreSource
GPQA DiamondEffort: NoneReported as: standard (no extended thinking)74.9%anthropic.com for Claude Opus 4 (standard (no extended thinking)) on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Launch postAnthropicSelf-reportedRecord for Claude Opus 4 on Graduate-Level Google-Proof Q&A Diamond
GPQA Diamond — Epoch AI harnessConfiguration: Epoch AI harness69.2%epoch.ai for Claude Opus 4 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Opus 4 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Vals AI harnessConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT71.7%vals.ai for Claude Opus 4 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
Humanity's Last Exam Full set — Scale AI evaluation6.7%labs.scale.com for Claude Opus 4 on Humanity's Last Exam Full set — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4 on Humanity's Last Exam Full set — Scale AI evaluation
Humanity's Last Exam Full set — Scale AI evaluationReported as: Thinking10.7%labs.scale.com for Claude Opus 4 (Thinking) on Humanity's Last Exam Full set — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4 on Humanity's Last Exam Full set — Scale AI evaluation
Humanity's Last Exam Text only — Scale AI evaluation6.3%labs.scale.com for Claude Opus 4 on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4 on Humanity's Last Exam Text only — Scale AI evaluation
Humanity's Last Exam Text only — Scale AI evaluationReported as: Thinking10.8%labs.scale.com for Claude Opus 4 (Thinking) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4 on Humanity's Last Exam Text only — Scale AI evaluation
MMMUEffort: NoneReported as: standard (no extended thinking)73.7%anthropic.com for Claude Opus 4 (standard (no extended thinking)) on Massive Multi-discipline Multimodal Understanding MMMU (opens in a new tab)MMMU AccuracyReported Launch postAnthropicSelf-reportedRecord for Claude Opus 4 on Massive Multi-discipline Multimodal Understanding MMMU
MMLU-Pro Original — Vals AI harnessConfiguration: Vals AI harness86.2%vals.ai for Claude Opus 4 on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4 on MMLU-Pro Original — Vals AI harness
MMMU-Pro Vals AI harnessConfiguration: Vals AI harness73.3%vals.ai for Claude Opus 4 on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4 on MMMU-Pro Vals AI harness
SWE-bench VerifiedEffort: NoneReported as: standard (no extended thinking)72.5%anthropic.com for Claude Opus 4 (standard (no extended thinking)) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postAnthropicSelf-reportedRecord for Claude Opus 4 on SWE-bench Verified
SWE-bench Verified — Epoch AI harnessConfiguration: Epoch AI harness70.7%epoch.ai for Claude Opus 4 on SWE-bench Verified — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Opus 4 on SWE-bench Verified — Epoch AI harness
SWE-bench Verified — mini-swe-agentConfiguration: mini-swe-agent harness67.6%github.com for Claude Opus 4 on SWE-bench Verified — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark repositorySWE-benchIndependentSWE-bench TeamRecord for Claude Opus 4 on SWE-bench Verified — mini-swe-agent