GPQA Diamond — Epoch AI harness Configuration: Epoch AI harness 73.2% epoch.ai for Claude Opus 4.1 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) GPQA Diamond Accuracy Reported October 7, 2026 Evaluated August 5, 2025 at 4:45 PM UTC Benchmark leaderboard Epoch AI Independent Record for Claude Opus 4.1 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness GPQA Diamond — Vals AI harness Configuration: Vals AI harness: mean of zero-shot and few-shot CoT 70.0% vals.ai for Claude Opus 4.1 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab) Archived copy (opens in a new tab) GPQA Diamond Accuracy Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Claude Opus 4.1 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness GPQA Diamond — Vals AI harness Reported as: thinking Configuration: Vals AI harness: mean of zero-shot and few-shot CoT 76.3% vals.ai for Claude Opus 4.1 (thinking) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab) Archived copy (opens in a new tab) GPQA Diamond Accuracy Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Claude Opus 4.1 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness Humanity's Last Exam Full set — Scale AI evaluation 7.9% labs.scale.com for Claude Opus 4.1 on Humanity's Last Exam Full set — Scale AI evaluation (opens in a new tab) Archived copy (opens in a new tab) Humanity's Last Exam Accuracy Reported October 3, 2026 Benchmark leaderboard Scale AI Independent Record for Claude Opus 4.1 on Humanity's Last Exam Full set — Scale AI evaluation Humanity's Last Exam Full set — Scale AI evaluation Reported as: thinking 11.5% labs.scale.com for Claude Opus 4.1 (thinking) on Humanity's Last Exam Full set — Scale AI evaluation (opens in a new tab) Archived copy (opens in a new tab) Humanity's Last Exam Accuracy Reported October 3, 2026 Benchmark leaderboard Scale AI Independent Record for Claude Opus 4.1 on Humanity's Last Exam Full set — Scale AI evaluation Humanity's Last Exam Text only — Scale AI evaluation 7.4% labs.scale.com for Claude Opus 4.1 on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab) Archived copy (opens in a new tab) Humanity's Last Exam Accuracy Reported October 7, 2026 Benchmark leaderboard Scale AI Independent Record for Claude Opus 4.1 on Humanity's Last Exam Text only — Scale AI evaluation Humanity's Last Exam Text only — Scale AI evaluation Reported as: thinking 11.3% labs.scale.com for Claude Opus 4.1 (thinking) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab) Archived copy (opens in a new tab) Humanity's Last Exam Accuracy Reported October 7, 2026 Benchmark leaderboard Scale AI Independent Record for Claude Opus 4.1 on Humanity's Last Exam Text only — Scale AI evaluation MMLU-Pro Original — Vals AI harness Configuration: Vals AI harness 87.2% vals.ai for Claude Opus 4.1 on MMLU-Pro Original — Vals AI harness (opens in a new tab) Archived copy (opens in a new tab) Accuracy Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Claude Opus 4.1 on MMLU-Pro Original — Vals AI harness MMLU-Pro Original — Vals AI harness Reported as: thinking Configuration: Vals AI harness 87.9% vals.ai for Claude Opus 4.1 (thinking) on MMLU-Pro Original — Vals AI harness (opens in a new tab) Archived copy (opens in a new tab) Accuracy Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Claude Opus 4.1 on MMLU-Pro Original — Vals AI harness MMMU-Pro Vals AI harness Configuration: Vals AI harness 73.7% vals.ai for Claude Opus 4.1 on MMMU-Pro Vals AI harness (opens in a new tab) Archived copy (opens in a new tab) MMMU-Pro accuracy Setting: Standard (4 options) Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Claude Opus 4.1 on MMMU-Pro Vals AI harness MMMU-Pro Vals AI harness Reported as: thinking Configuration: Vals AI harness 77.5% vals.ai for Claude Opus 4.1 (thinking) on MMMU-Pro Vals AI harness (opens in a new tab) Archived copy (opens in a new tab) MMMU-Pro accuracy Setting: Standard (4 options) Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Claude Opus 4.1 on MMMU-Pro Vals AI harness SWE-bench Verified — Epoch AI harness Configuration: Epoch AI harness 73.3% epoch.ai for Claude Opus 4.1 on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated February 11, 2026 at 9:33 PM UTC Benchmark leaderboard Epoch AI Independent Record for Claude Opus 4.1 on SWE-bench Verified — Epoch AI harness SWE-bench Pro Private — Scale AI SWE-Agent Configuration: SWE-Agent harness, 250 turns, uncapped cost 17.8% labs.scale.com for Claude Opus 4.1 on SWE-bench Pro Private — Scale AI SWE-Agent (opens in a new tab) Archived copy (opens in a new tab) Public tasks resolved Reported October 7, 2026 Benchmark leaderboard Scale AI Independent Record for Claude Opus 4.1 on SWE-bench Pro Private — Scale AI SWE-Agent