Benchmarks

13 results across 6 benchmarks

Benchmark results for Claude Opus 4.1
BenchmarkScoreSource
GPQA Diamond — Epoch AI harnessConfiguration: Epoch AI harness73.2%epoch.ai for Claude Opus 4.1 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Opus 4.1 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Vals AI harnessConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT70.0%vals.ai for Claude Opus 4.1 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.1 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
GPQA Diamond — Vals AI harnessReported as: thinkingConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT76.3%vals.ai for Claude Opus 4.1 (thinking) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.1 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
Humanity's Last Exam Full set — Scale AI evaluation7.9%labs.scale.com for Claude Opus 4.1 on Humanity's Last Exam Full set — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.1 on Humanity's Last Exam Full set — Scale AI evaluation
Humanity's Last Exam Full set — Scale AI evaluationReported as: thinking11.5%labs.scale.com for Claude Opus 4.1 (thinking) on Humanity's Last Exam Full set — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.1 on Humanity's Last Exam Full set — Scale AI evaluation
Humanity's Last Exam Text only — Scale AI evaluation7.4%labs.scale.com for Claude Opus 4.1 on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.1 on Humanity's Last Exam Text only — Scale AI evaluation
Humanity's Last Exam Text only — Scale AI evaluationReported as: thinking11.3%labs.scale.com for Claude Opus 4.1 (thinking) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.1 on Humanity's Last Exam Text only — Scale AI evaluation
MMLU-Pro Original — Vals AI harnessConfiguration: Vals AI harness87.2%vals.ai for Claude Opus 4.1 on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.1 on MMLU-Pro Original — Vals AI harness
MMLU-Pro Original — Vals AI harnessReported as: thinkingConfiguration: Vals AI harness87.9%vals.ai for Claude Opus 4.1 (thinking) on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.1 on MMLU-Pro Original — Vals AI harness
MMMU-Pro Vals AI harnessConfiguration: Vals AI harness73.7%vals.ai for Claude Opus 4.1 on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.1 on MMMU-Pro Vals AI harness
MMMU-Pro Vals AI harnessReported as: thinkingConfiguration: Vals AI harness77.5%vals.ai for Claude Opus 4.1 (thinking) on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.1 on MMMU-Pro Vals AI harness
SWE-bench Verified — Epoch AI harnessConfiguration: Epoch AI harness73.3%epoch.ai for Claude Opus 4.1 on SWE-bench Verified — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Opus 4.1 on SWE-bench Verified — Epoch AI harness
SWE-bench Pro Private — Scale AI SWE-AgentConfiguration: SWE-Agent harness, 250 turns, uncapped cost17.8%labs.scale.com for Claude Opus 4.1 on SWE-bench Pro Private — Scale AI SWE-Agent (opens in a new tab)Archived copy (opens in a new tab)Public tasks resolvedReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.1 on SWE-bench Pro Private — Scale AI SWE-Agent