Benchmarks

55 results across 25 benchmarks

Benchmark results for Claude Sonnet 5
BenchmarkScoreSource
APEX-Agents OriginalEffort: Max54.5%mercor.com for Claude Sonnet 5 (max) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5 on APEX-Agents Original
AutomationBench 1.0.6Effort: Low3.7%zapier.com for Claude Sonnet 5 (low) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Sonnet 5 on AutomationBench 1.0.6
AutomationBench 1.0.6Effort: Medium5.8%zapier.com for Claude Sonnet 5 (medium) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Sonnet 5 on AutomationBench 1.0.6
AutomationBench 1.0.6Effort: High9.9%zapier.com for Claude Sonnet 5 (high) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Sonnet 5 on AutomationBench 1.0.6
AutomationBench 1.0.6Effort: xHigh7.6%zapier.com for Claude Sonnet 5 (xhigh) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Sonnet 5 on AutomationBench 1.0.6
AutomationBench 1.0.6Effort: Max10.7%zapier.com for Claude Sonnet 5 (max) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Sonnet 5 on AutomationBench 1.0.6
BrowseComp 130-question subset — Mercor web research agentEffort: MaxConfiguration: Mercor web research agent, 100 steps, 3 hours68.7%mercor.com for Claude Sonnet 5 (max) on BrowseComp 130-question subset — Mercor web research agent (opens in a new tab)Archived copy (opens in a new tab)BrowseComp AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5 on BrowseComp 130-question subset — Mercor web research agent
Chartography October 2026 leaderboardEffort: MaxReported as: Adaptive/Max16.6%surgehq.ai for Claude Sonnet 5 (Adaptive/Max) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Claude Sonnet 5 on Chartography October 2026 leaderboard
CharXiv Descriptive and reasoning — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent88.8%mercor.com for Claude Sonnet 5 (max) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)CharXiv AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5 on CharXiv Descriptive and reasoning — Mercor single-shot
CharXiv Reasoning — No toolsEffort: MaxConfiguration: No tools77.0%www-cdn.anthropic.com for Claude Sonnet 5 (max) on CharXiv Reasoning — No tools (opens in a new tab)CharXiv AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5 on CharXiv Reasoning — No tools
CharXiv Reasoning — Python enabledEffort: MaxConfiguration: With Python88.3%www-cdn.anthropic.com for Claude Sonnet 5 (max) on CharXiv Reasoning — Python enabled (opens in a new tab)CharXiv AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5 on CharXiv Reasoning — Python enabled
CursorBench 4.0Effort: Low24.1%cursor.com for Claude Sonnet 5 (low) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Claude Sonnet 5 on CursorBench 4.0
CursorBench 4.0Effort: Medium28.0%cursor.com for Claude Sonnet 5 (medium) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Claude Sonnet 5 on CursorBench 4.0
CursorBench 4.0Effort: High30.8%cursor.com for Claude Sonnet 5 (high) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Claude Sonnet 5 on CursorBench 4.0
CursorBench 4.0Effort: xHigh32.0%cursor.com for Claude Sonnet 5 (xhigh) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Claude Sonnet 5 on CursorBench 4.0
CursorBench 4.0Effort: Max34.1%cursor.com for Claude Sonnet 5 (max) on CursorBench 4.0 (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Claude Sonnet 5 on CursorBench 4.0
DeepSWE 1.1Effort: Max54.0%deepswe.datacurve.ai for Claude Sonnet 5 (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for Claude Sonnet 5 on DeepSWE 1.1
DeepSWE 1.1 — Mercor mini-swe-agent, 500 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 500 steps, 2 hours49.6%mercor.com for Claude Sonnet 5 (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps
Finance Agent Benchmark 2 — October 2026 evaluation53.9%vals.ai for Claude Sonnet 5 on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Finance Agent AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 5 on Finance Agent Benchmark 2 — October 2026 evaluation
Global MMLU OriginalEffort: Max89.0%www-cdn.anthropic.com for Claude Sonnet 5 (max) on Global MMLU Original (opens in a new tab)Average accuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5 on Global MMLU Original
GPQA Diamond — Epoch AI harnessEffort: xHighConfiguration: Epoch AI harness90.5%epoch.ai for Claude Sonnet 5 (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Sonnet 5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Epoch AI harnessEffort: MaxConfiguration: Epoch AI harness80.3%epoch.ai for Claude Sonnet 5 (max) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Sonnet 5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent80.6%mercor.com for Claude Sonnet 5 (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot
GPQA Diamond — Vals AI harnessConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT88.9%vals.ai for Claude Sonnet 5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
HLAB October 2026 evaluation5.0%vals.ai for Claude Sonnet 5 on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)HLAB Task Pass RateReported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 5 on Harvey's Legal Agent Benchmark October 2026 evaluation
Humanity's Last Exam Full set — No toolsEffort: MaxConfiguration: No tools43.2%www-cdn.anthropic.com for Claude Sonnet 5 (max) on Humanity's Last Exam Full set — No tools (opens in a new tab)Humanity's Last Exam AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5 on Humanity's Last Exam Full set — No tools
Humanity's Last Exam Full set — With toolsEffort: LowConfiguration: With tools36.5%www-cdn.anthropic.com for Claude Sonnet 5 (low) on Humanity's Last Exam Full set — With tools (opens in a new tab)Humanity's Last Exam AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5 on Humanity's Last Exam Full set — With tools
Humanity's Last Exam Full set — With toolsEffort: MediumConfiguration: With tools47.2%www-cdn.anthropic.com for Claude Sonnet 5 (medium) on Humanity's Last Exam Full set — With tools (opens in a new tab)Humanity's Last Exam AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5 on Humanity's Last Exam Full set — With tools
Humanity's Last Exam Full set — With toolsEffort: HighConfiguration: With tools52.8%www-cdn.anthropic.com for Claude Sonnet 5 (high) on Humanity's Last Exam Full set — With tools (opens in a new tab)Humanity's Last Exam AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5 on Humanity's Last Exam Full set — With tools
Humanity's Last Exam Full set — With toolsEffort: xHighConfiguration: With tools54.6%www-cdn.anthropic.com for Claude Sonnet 5 (xhigh) on Humanity's Last Exam Full set — With tools (opens in a new tab)Humanity's Last Exam AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5 on Humanity's Last Exam Full set — With tools
Humanity's Last Exam Text only — Mercor single-shotEffort: HighConfiguration: Mercor single-shot agent36.3%mercor.com for Claude Sonnet 5 (high) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5 on Humanity's Last Exam Text only — Mercor single-shot
Humanity's Last Exam Text only — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent27.3%mercor.com for Claude Sonnet 5 (max) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5 on Humanity's Last Exam Text only — Mercor single-shot
MedXpertQA MM — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent63.0%mercor.com for Claude Sonnet 5 (max) on MedXpertQA MM — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5 on MedXpertQA MM — Mercor single-shot
MMLU-Pro Original — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent88.5%mercor.com for Claude Sonnet 5 (max) on MMLU-Pro Original — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5 on MMLU-Pro Original — Mercor single-shot
MMLU-Pro Original — Vals AI harnessConfiguration: Vals AI harness87.5%vals.ai for Claude Sonnet 5 on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 5 on MMLU-Pro Original — Vals AI harness
MMMU-Pro 1,730 questions — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent75.5%mercor.com for Claude Sonnet 5 (max) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5 on MMMU-Pro 1,730 questions — Mercor single-shot
MMMU-Pro Vals AI harnessConfiguration: Vals AI harness83.0%vals.ai for Claude Sonnet 5 on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 5 on MMMU-Pro Vals AI harness
MILU OriginalEffort: Max89.3%www-cdn.anthropic.com for Claude Sonnet 5 (max) on Multi-task Indic Language Understanding Benchmark Original (opens in a new tab)Average accuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5 on Multi-task Indic Language Understanding Benchmark Original
OSWorld VerifiedEffort: Max81.2%www-cdn.anthropic.com for Claude Sonnet 5 (max) on OSWorld Verified (opens in a new tab)OSWorld-Verified success rateReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5 on OSWorld Verified
SimpleQA Verified Original — Epoch AI harnessEffort: xHighConfiguration: Epoch AI harness32.9%epoch.ai for Claude Sonnet 5 (xhigh) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Sonnet 5 on SimpleQA Verified Original — Epoch AI harness
SimpleQA Verified Original — Epoch AI harnessEffort: MaxConfiguration: Epoch AI harness33.7%epoch.ai for Claude Sonnet 5 (max) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Sonnet 5 on SimpleQA Verified Original — Epoch AI harness
SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 250 steps, 1 hour39.5%mercor.com for Claude Sonnet 5 (max) on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
SWE-bench MultilingualEffort: Max78.3%www-cdn.anthropic.com for Claude Sonnet 5 (max) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5 on SWE-bench Multilingual
SWE-bench Multilingual — Mercor mini-swe-agent, 1000 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 1000 steps, 3 hours89.2%mercor.com for Claude Sonnet 5 (max) on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5 on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps
SWE-bench VerifiedEffort: Max85.2%www-cdn.anthropic.com for Claude Sonnet 5 (max) on SWE-bench Verified (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5 on SWE-bench Verified
SWE-bench Verified — Mercor mini-swe-agent, 1000 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 1000 steps, 3 hours82.8%mercor.com for Claude Sonnet 5 (max) on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5 on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps
SWE-bench Verified — Vals AI mini-swe-agentConfiguration: mini-swe-agent harness79.6%vals.ai for Claude Sonnet 5 on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 5 on SWE-bench Verified — Vals AI mini-swe-agent
SWE-bench Pro PublicEffort: Max63.2%www-cdn.anthropic.com for Claude Sonnet 5 (max) on SWE-bench Pro Public (opens in a new tab)Public tasks resolvedReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5 on SWE-bench Pro Public
Terminal-Bench 2.1 — mini-swe-agentEffort: xHighConfiguration: mini-swe-agent harness80.4%www-cdn.anthropic.com for Claude Sonnet 5 (xhigh) on Terminal-Bench 2.1 — mini-swe-agent (opens in a new tab)Terminal-Bench AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5 on Terminal-Bench 2.1 — mini-swe-agent
Terminal-Bench 2.1 — Vals AI Terminus 2Configuration: Terminus-2 harness74.5%vals.ai for Claude Sonnet 5 on Terminal-Bench 2.1 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 5 on Terminal-Bench 2.1 — Vals AI Terminus 2