APEX-Agents Original Effort: Max 54.5% mercor.com for Claude Sonnet 5 (max) on APEX-Agents Original (opens in a new tab) Archived copy (opens in a new tab) Pass rate Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Sonnet 5 on APEX-Agents Original AutomationBench 1.0.6 Effort: Low 3.7% zapier.com for Claude Sonnet 5 (low) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Sonnet 5 on AutomationBench 1.0.6 AutomationBench 1.0.6 Effort: Medium 5.8% zapier.com for Claude Sonnet 5 (medium) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Sonnet 5 on AutomationBench 1.0.6 AutomationBench 1.0.6 Effort: High 9.9% zapier.com for Claude Sonnet 5 (high) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Sonnet 5 on AutomationBench 1.0.6 AutomationBench 1.0.6 Effort: xHigh 7.6% zapier.com for Claude Sonnet 5 (xhigh) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Sonnet 5 on AutomationBench 1.0.6 AutomationBench 1.0.6 Effort: Max 10.7% zapier.com for Claude Sonnet 5 (max) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Sonnet 5 on AutomationBench 1.0.6 BrowseComp 130-question subset — Mercor web research agent Effort: Max Configuration: Mercor web research agent, 100 steps, 3 hours 68.7% mercor.com for Claude Sonnet 5 (max) on BrowseComp 130-question subset — Mercor web research agent (opens in a new tab) Archived copy (opens in a new tab) BrowseComp Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Sonnet 5 on BrowseComp 130-question subset — Mercor web research agent Chartography October 2026 leaderboard Effort: Max Reported as: Adaptive/Max 16.6% surgehq.ai for Claude Sonnet 5 (Adaptive/Max) on Chartography October 2026 leaderboard (opens in a new tab) Archived copy (opens in a new tab) Chartography Pass@1 Reported October 7, 2026 Benchmark leaderboard Surge AI Independent Record for Claude Sonnet 5 on Chartography October 2026 leaderboard CharXiv Descriptive and reasoning — Mercor single-shot Effort: Max Configuration: Mercor single-shot agent 88.8% mercor.com for Claude Sonnet 5 (max) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab) Archived copy (opens in a new tab) CharXiv Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Sonnet 5 on CharXiv Descriptive and reasoning — Mercor single-shot CharXiv Reasoning — No tools Effort: Max Configuration: No tools 77.0% www-cdn.anthropic.com for Claude Sonnet 5 (max) on CharXiv Reasoning — No tools (opens in a new tab) CharXiv Accuracy Reported June 30, 2026 System card Anthropic Self-reported Record for Claude Sonnet 5 on CharXiv Reasoning — No tools CharXiv Reasoning — Python enabled Effort: Max Configuration: With Python 88.3% www-cdn.anthropic.com for Claude Sonnet 5 (max) on CharXiv Reasoning — Python enabled (opens in a new tab) CharXiv Accuracy Reported June 30, 2026 System card Anthropic Self-reported Record for Claude Sonnet 5 on CharXiv Reasoning — Python enabled CursorBench 4.0 Effort: Low 24.1% cursor.com for Claude Sonnet 5 (low) on CursorBench 4.0 (opens in a new tab) Archived copy (opens in a new tab) CursorBench Accuracy Reported October 7, 2026 Benchmark leaderboard Cursor Independent Record for Claude Sonnet 5 on CursorBench 4.0 CursorBench 4.0 Effort: Medium 28.0% cursor.com for Claude Sonnet 5 (medium) on CursorBench 4.0 (opens in a new tab) Archived copy (opens in a new tab) CursorBench Accuracy Reported October 7, 2026 Benchmark leaderboard Cursor Independent Record for Claude Sonnet 5 on CursorBench 4.0 CursorBench 4.0 Effort: High 30.8% cursor.com for Claude Sonnet 5 (high) on CursorBench 4.0 (opens in a new tab) Archived copy (opens in a new tab) CursorBench Accuracy Reported October 7, 2026 Benchmark leaderboard Cursor Independent Record for Claude Sonnet 5 on CursorBench 4.0 CursorBench 4.0 Effort: xHigh 32.0% cursor.com for Claude Sonnet 5 (xhigh) on CursorBench 4.0 (opens in a new tab) Archived copy (opens in a new tab) CursorBench Accuracy Reported October 7, 2026 Benchmark leaderboard Cursor Independent Record for Claude Sonnet 5 on CursorBench 4.0 CursorBench 4.0 Effort: Max 34.1% cursor.com for Claude Sonnet 5 (max) on CursorBench 4.0 (opens in a new tab) CursorBench Accuracy Reported September 10, 2026 Benchmark leaderboard Cursor Independent Record for Claude Sonnet 5 on CursorBench 4.0 DeepSWE 1.1 Effort: Max 54.0% deepswe.datacurve.ai for Claude Sonnet 5 (max) on DeepSWE 1.1 (opens in a new tab) DeepSWE Pass@1 Reported September 22, 2026 Benchmark leaderboard Datacurve Independent Record for Claude Sonnet 5 on DeepSWE 1.1 DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps Effort: Max Configuration: Mercor mini-swe-agent, 500 steps, 2 hours 49.6% mercor.com for Claude Sonnet 5 (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Sonnet 5 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps Finance Agent Benchmark 2 — October 2026 evaluation 53.9% vals.ai for Claude Sonnet 5 on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab) Archived copy (opens in a new tab) Finance Agent Accuracy Reported October 6, 2026 Benchmark leaderboard Vals AI Independent Record for Claude Sonnet 5 on Finance Agent Benchmark 2 — October 2026 evaluation Global MMLU Original Effort: Max 89.0% www-cdn.anthropic.com for Claude Sonnet 5 (max) on Global MMLU Original (opens in a new tab) Average accuracy Reported June 30, 2026 System card Anthropic Self-reported Record for Claude Sonnet 5 on Global MMLU Original GPQA Diamond — Epoch AI harness Effort: xHigh Configuration: Epoch AI harness 90.5% epoch.ai for Claude Sonnet 5 (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) GPQA Diamond Accuracy Reported October 7, 2026 Evaluated July 1, 2026 at 1:22 AM UTC Benchmark leaderboard Epoch AI Independent Record for Claude Sonnet 5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness GPQA Diamond — Epoch AI harness Effort: Max Configuration: Epoch AI harness 80.3% epoch.ai for Claude Sonnet 5 (max) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) GPQA Diamond Accuracy Reported October 7, 2026 Evaluated August 6, 2026 at 10:21 PM UTC Benchmark leaderboard Epoch AI Independent Record for Claude Sonnet 5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness GPQA Diamond — Mercor single-shot Effort: Max Configuration: Mercor single-shot agent 80.6% mercor.com for Claude Sonnet 5 (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab) Archived copy (opens in a new tab) GPQA Diamond Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Sonnet 5 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot GPQA Diamond — Vals AI harness Configuration: Vals AI harness: mean of zero-shot and few-shot CoT 88.9% vals.ai for Claude Sonnet 5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab) Archived copy (opens in a new tab) GPQA Diamond Accuracy Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Claude Sonnet 5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness HLAB October 2026 evaluation 5.0% vals.ai for Claude Sonnet 5 on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab) Archived copy (opens in a new tab) HLAB Task Pass Rate Reported October 6, 2026 Benchmark leaderboard Vals AI Independent Record for Claude Sonnet 5 on Harvey's Legal Agent Benchmark October 2026 evaluation Humanity's Last Exam Full set — No tools Effort: Max Configuration: No tools 43.2% www-cdn.anthropic.com for Claude Sonnet 5 (max) on Humanity's Last Exam Full set — No tools (opens in a new tab) Humanity's Last Exam Accuracy Reported June 30, 2026 System card Anthropic Self-reported Record for Claude Sonnet 5 on Humanity's Last Exam Full set — No tools Humanity's Last Exam Full set — With tools Effort: Low Configuration: With tools 36.5% www-cdn.anthropic.com for Claude Sonnet 5 (low) on Humanity's Last Exam Full set — With tools (opens in a new tab) Humanity's Last Exam Accuracy Reported June 30, 2026 System card Anthropic Self-reported Record for Claude Sonnet 5 on Humanity's Last Exam Full set — With tools Humanity's Last Exam Full set — With tools Effort: Medium Configuration: With tools 47.2% www-cdn.anthropic.com for Claude Sonnet 5 (medium) on Humanity's Last Exam Full set — With tools (opens in a new tab) Humanity's Last Exam Accuracy Reported June 30, 2026 System card Anthropic Self-reported Record for Claude Sonnet 5 on Humanity's Last Exam Full set — With tools Humanity's Last Exam Full set — With tools Effort: High Configuration: With tools 52.8% www-cdn.anthropic.com for Claude Sonnet 5 (high) on Humanity's Last Exam Full set — With tools (opens in a new tab) Humanity's Last Exam Accuracy Reported June 30, 2026 System card Anthropic Self-reported Record for Claude Sonnet 5 on Humanity's Last Exam Full set — With tools Humanity's Last Exam Full set — With tools Effort: xHigh Configuration: With tools 54.6% www-cdn.anthropic.com for Claude Sonnet 5 (xhigh) on Humanity's Last Exam Full set — With tools (opens in a new tab) Humanity's Last Exam Accuracy Reported June 30, 2026 System card Anthropic Self-reported Record for Claude Sonnet 5 on Humanity's Last Exam Full set — With tools Humanity's Last Exam Text only — Mercor single-shot Effort: High Configuration: Mercor single-shot agent 36.3% mercor.com for Claude Sonnet 5 (high) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab) Archived copy (opens in a new tab) Humanity's Last Exam Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Sonnet 5 on Humanity's Last Exam Text only — Mercor single-shot Humanity's Last Exam Text only — Mercor single-shot Effort: Max Configuration: Mercor single-shot agent 27.3% mercor.com for Claude Sonnet 5 (max) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab) Archived copy (opens in a new tab) Humanity's Last Exam Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Sonnet 5 on Humanity's Last Exam Text only — Mercor single-shot MedXpertQA MM — Mercor single-shot Effort: Max Configuration: Mercor single-shot agent 63.0% mercor.com for Claude Sonnet 5 (max) on MedXpertQA MM — Mercor single-shot (opens in a new tab) Archived copy (opens in a new tab) Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Sonnet 5 on MedXpertQA MM — Mercor single-shot MMLU-Pro Original — Mercor single-shot Effort: Max Configuration: Mercor single-shot agent 88.5% mercor.com for Claude Sonnet 5 (max) on MMLU-Pro Original — Mercor single-shot (opens in a new tab) Archived copy (opens in a new tab) Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Sonnet 5 on MMLU-Pro Original — Mercor single-shot MMLU-Pro Original — Vals AI harness Configuration: Vals AI harness 87.5% vals.ai for Claude Sonnet 5 on MMLU-Pro Original — Vals AI harness (opens in a new tab) Archived copy (opens in a new tab) Accuracy Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Claude Sonnet 5 on MMLU-Pro Original — Vals AI harness MMMU-Pro 1,730 questions — Mercor single-shot Effort: Max Configuration: Mercor single-shot agent 75.5% mercor.com for Claude Sonnet 5 (max) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab) Archived copy (opens in a new tab) MMMU-Pro accuracy Setting: Not stated Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Sonnet 5 on MMMU-Pro 1,730 questions — Mercor single-shot MMMU-Pro Vals AI harness Configuration: Vals AI harness 83.0% vals.ai for Claude Sonnet 5 on MMMU-Pro Vals AI harness (opens in a new tab) Archived copy (opens in a new tab) MMMU-Pro accuracy Setting: Standard (4 options) Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Claude Sonnet 5 on MMMU-Pro Vals AI harness MILU Original Effort: Max 89.3% www-cdn.anthropic.com for Claude Sonnet 5 (max) on Multi-task Indic Language Understanding Benchmark Original (opens in a new tab) Average accuracy Reported June 30, 2026 System card Anthropic Self-reported Record for Claude Sonnet 5 on Multi-task Indic Language Understanding Benchmark Original OSWorld Verified Effort: Max 81.2% www-cdn.anthropic.com for Claude Sonnet 5 (max) on OSWorld Verified (opens in a new tab) OSWorld-Verified success rate Reported June 30, 2026 System card Anthropic Self-reported Record for Claude Sonnet 5 on OSWorld Verified SimpleQA Verified Original — Epoch AI harness Effort: xHigh Configuration: Epoch AI harness 32.9% epoch.ai for Claude Sonnet 5 (xhigh) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Accuracy Reported October 7, 2026 Evaluated August 27, 2026 at 7:28 PM UTC Benchmark leaderboard Epoch AI Independent Record for Claude Sonnet 5 on SimpleQA Verified Original — Epoch AI harness SimpleQA Verified Original — Epoch AI harness Effort: Max Configuration: Epoch AI harness 33.7% epoch.ai for Claude Sonnet 5 (max) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Accuracy Reported October 7, 2026 Evaluated August 27, 2026 at 7:27 PM UTC Benchmark leaderboard Epoch AI Independent Record for Claude Sonnet 5 on SimpleQA Verified Original — Epoch AI harness SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps Effort: Max Configuration: Mercor mini-swe-agent, 250 steps, 1 hour 39.5% mercor.com for Claude Sonnet 5 (max) on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps (opens in a new tab) Archived copy (opens in a new tab) Mean pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Sonnet 5 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps SWE-bench Multilingual Effort: Max 78.3% www-cdn.anthropic.com for Claude Sonnet 5 (max) on SWE-bench Multilingual (opens in a new tab) Resolved Tasks Reported June 30, 2026 System card Anthropic Self-reported Record for Claude Sonnet 5 on SWE-bench Multilingual SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps Effort: Max Configuration: Mercor mini-swe-agent, 1000 steps, 3 hours 89.2% mercor.com for Claude Sonnet 5 (max) on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Sonnet 5 on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps SWE-bench Verified Effort: Max 85.2% www-cdn.anthropic.com for Claude Sonnet 5 (max) on SWE-bench Verified (opens in a new tab) Resolved Tasks Reported June 30, 2026 System card Anthropic Self-reported Record for Claude Sonnet 5 on SWE-bench Verified SWE-bench Verified — Mercor mini-swe-agent, 1000 steps Effort: Max Configuration: Mercor mini-swe-agent, 1000 steps, 3 hours 82.8% mercor.com for Claude Sonnet 5 (max) on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Sonnet 5 on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps SWE-bench Verified — Vals AI mini-swe-agent Configuration: mini-swe-agent harness 79.6% vals.ai for Claude Sonnet 5 on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Claude Sonnet 5 on SWE-bench Verified — Vals AI mini-swe-agent SWE-bench Pro Public Effort: Max 63.2% www-cdn.anthropic.com for Claude Sonnet 5 (max) on SWE-bench Pro Public (opens in a new tab) Public tasks resolved Reported June 30, 2026 System card Anthropic Self-reported Record for Claude Sonnet 5 on SWE-bench Pro Public Terminal-Bench 2.1 — mini-swe-agent Effort: xHigh Configuration: mini-swe-agent harness 80.4% www-cdn.anthropic.com for Claude Sonnet 5 (xhigh) on Terminal-Bench 2.1 — mini-swe-agent (opens in a new tab) Terminal-Bench Accuracy Reported June 30, 2026 System card Anthropic Self-reported Record for Claude Sonnet 5 on Terminal-Bench 2.1 — mini-swe-agent Terminal-Bench 2.1 — Vals AI Terminus 2 Configuration: Terminus-2 harness 74.5% vals.ai for Claude Sonnet 5 on Terminal-Bench 2.1 — Vals AI Terminus 2 (opens in a new tab) Archived copy (opens in a new tab) Terminal-Bench Accuracy Reported September 28, 2026 Benchmark leaderboard Vals AI Independent Record for Claude Sonnet 5 on Terminal-Bench 2.1 — Vals AI Terminus 2