Benchmarks

46 results across 20 benchmarks

Benchmark results for Claude Sonnet 4.6
BenchmarkScoreSource
APEX-Agents OriginalEffort: High43.0%mercor.com for Claude Sonnet 4.6 (high) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 4.6 on APEX-Agents Original
AutomationBench 1.0.6Effort: Low2.9%zapier.com for Claude Sonnet 4.6 (low) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Sonnet 4.6 on AutomationBench 1.0.6
AutomationBench 1.0.6Effort: Medium3.7%zapier.com for Claude Sonnet 4.6 (medium) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Sonnet 4.6 on AutomationBench 1.0.6
AutomationBench 1.0.6Effort: High5.0%zapier.com for Claude Sonnet 4.6 (high) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Sonnet 4.6 on AutomationBench 1.0.6
AutomationBench 1.0.6Effort: Max5.3%zapier.com for Claude Sonnet 4.6 (max) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Sonnet 4.6 on AutomationBench 1.0.6
BrowseComp 130-question subset — Mercor web research agentEffort: HighConfiguration: Mercor web research agent, 100 steps, 3 hours56.7%mercor.com for Claude Sonnet 4.6 (high) on BrowseComp 130-question subset — Mercor web research agent (opens in a new tab)Archived copy (opens in a new tab)BrowseComp AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 4.6 on BrowseComp 130-question subset — Mercor web research agent
CharXiv Descriptive and reasoning — Mercor single-shotEffort: HighConfiguration: Mercor single-shot agent90.5%mercor.com for Claude Sonnet 4.6 (high) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)CharXiv AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 4.6 on CharXiv Descriptive and reasoning — Mercor single-shot
DeepSWE 1.1 — Mercor mini-swe-agent, 500 stepsEffort: HighConfiguration: Mercor mini-swe-agent, 500 steps, 2 hours34.2%mercor.com for Claude Sonnet 4.6 (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 4.6 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps
Finance Agent Benchmark 2 — October 2026 evaluation51.0%vals.ai for Claude Sonnet 4.6 on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Finance Agent AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 4.6 on Finance Agent Benchmark 2 — October 2026 evaluation
GPQA DiamondEffort: MaxReported as: adaptive thinking, max89.9%www-cdn.anthropic.com for Claude Sonnet 4.6 (adaptive thinking, max) on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 4.6 on Graduate-Level Google-Proof Q&A Diamond
GPQA Diamond — Epoch AI harnessEffort: MediumConfiguration: Epoch AI harness83.3%epoch.ai for Claude Sonnet 4.6 (medium) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Sonnet 4.6 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Epoch AI harnessEffort: HighConfiguration: Epoch AI harness83.3%epoch.ai for Claude Sonnet 4.6 (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Sonnet 4.6 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Epoch AI harnessEffort: MaxConfiguration: Epoch AI harness78.8%epoch.ai for Claude Sonnet 4.6 (max) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Sonnet 4.6 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Mercor single-shotEffort: HighConfiguration: Mercor single-shot agent84.7%mercor.com for Claude Sonnet 4.6 (high) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 4.6 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot
GPQA Diamond — Vals AI harnessConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT85.6%vals.ai for Claude Sonnet 4.6 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 4.6 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
HLAB October 2026 evaluation5.0%vals.ai for Claude Sonnet 4.6 on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)HLAB Task Pass RateReported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 4.6 on Harvey's Legal Agent Benchmark October 2026 evaluation
Humanity's Last Exam Full set — No toolsEffort: MaxReported as: adaptive thinking, maxConfiguration: No tools33.2%www-cdn.anthropic.com for Claude Sonnet 4.6 (adaptive thinking, max) on Humanity's Last Exam Full set — No tools (opens in a new tab)Humanity's Last Exam AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 4.6 on Humanity's Last Exam Full set — No tools
Humanity's Last Exam Full set — With toolsEffort: MaxReported as: adaptive thinking, maxConfiguration: With tools49.0%www-cdn.anthropic.com for Claude Sonnet 4.6 (adaptive thinking, max) on Humanity's Last Exam Full set — With tools (opens in a new tab)Humanity's Last Exam AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 4.6 on Humanity's Last Exam Full set — With tools
Humanity's Last Exam Text only — Mercor single-shotEffort: MediumConfiguration: Mercor single-shot agent29.2%mercor.com for Claude Sonnet 4.6 (medium) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 4.6 on Humanity's Last Exam Text only — Mercor single-shot
Humanity's Last Exam Text only — Mercor single-shotEffort: HighConfiguration: Mercor single-shot agent24.4%mercor.com for Claude Sonnet 4.6 (high) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 4.6 on Humanity's Last Exam Text only — Mercor single-shot
MCP Atlas Public, April 2026 update69.5%labs.scale.com for Claude Sonnet 4.6 on MCP Atlas Public, April 2026 update (opens in a new tab)Pass rateReported Benchmark leaderboardScale AIIndependentRecord for Claude Sonnet 4.6 on MCP Atlas Public, April 2026 update
MedXpertQA MM — Mercor single-shotEffort: HighConfiguration: Mercor single-shot agent61.7%mercor.com for Claude Sonnet 4.6 (high) on MedXpertQA MM — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 4.6 on MedXpertQA MM — Mercor single-shot
MMLU-Pro Original — Mercor single-shotEffort: HighConfiguration: Mercor single-shot agent88.0%mercor.com for Claude Sonnet 4.6 (high) on MMLU-Pro Original — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 4.6 on MMLU-Pro Original — Mercor single-shot
MMLU-Pro Original — Vals AI harnessConfiguration: Vals AI harness87.3%vals.ai for Claude Sonnet 4.6 on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 4.6 on MMLU-Pro Original — Vals AI harness
MMMU-Pro 1,730 questions — Mercor single-shotEffort: HighConfiguration: Mercor single-shot agent74.6%mercor.com for Claude Sonnet 4.6 (high) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 4.6 on MMMU-Pro 1,730 questions — Mercor single-shot
MMMU-Pro No toolsEffort: MaxReported as: adaptive thinking, maxConfiguration: No tools74.5%www-cdn.anthropic.com for Claude Sonnet 4.6 (adaptive thinking, max) on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Overall (Standard 10 options + Vision)Reported System cardAnthropicSelf-reportedRecord for Claude Sonnet 4.6 on MMMU-Pro No tools
MMMU-Pro Vals AI harnessConfiguration: Vals AI harness83.6%vals.ai for Claude Sonnet 4.6 on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 4.6 on MMMU-Pro Vals AI harness
OSWorld VerifiedEffort: MaxReported as: adaptive thinking, max72.5%www-cdn.anthropic.com for Claude Sonnet 4.6 (adaptive thinking, max) on OSWorld Verified (opens in a new tab)OSWorld-Verified success rateReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 4.6 on OSWorld Verified
OSWorld Verified — 100 stepsConfiguration: 100-step limit72.1%os-world.github.io for Claude Sonnet 4.6 on OSWorld Verified — 100 steps (opens in a new tab)Archived copy (opens in a new tab)OSWorld-Verified success rateReported Benchmark leaderboardOSWorldIndependentXLang LabRecord for Claude Sonnet 4.6 on OSWorld Verified — 100 steps
SimpleQA Verified Original — Epoch AI harnessEffort: HighConfiguration: Epoch AI harness35.5%epoch.ai for Claude Sonnet 4.6 (high) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Sonnet 4.6 on SimpleQA Verified Original — Epoch AI harness
SimpleQA Verified Original — Epoch AI harnessEffort: MaxConfiguration: Epoch AI harness32.8%epoch.ai for Claude Sonnet 4.6 (max) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Sonnet 4.6 on SimpleQA Verified Original — Epoch AI harness
SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 stepsEffort: HighConfiguration: Mercor mini-swe-agent, 250 steps, 1 hour35.5%mercor.com for Claude Sonnet 4.6 (high) on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 4.6 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
SWE Atlas Codebase QnA — Public; Claude CodeConfiguration: Claude Code harness31.2%labs.scale.com for Claude Sonnet 4.6 on SWE Atlas Codebase QnA — Public; Claude Code (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Claude Sonnet 4.6 on SWE Atlas Codebase QnA — Public; Claude Code
SWE Atlas Refactoring — Claude CodeConfiguration: Claude Code harness32.2%labs.scale.com for Claude Sonnet 4.6 on SWE Atlas Refactoring — Claude Code (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Claude Sonnet 4.6 on SWE Atlas Refactoring — Claude Code
SWE-bench MultilingualEffort: MaxReported as: adaptive thinking, max75.9%www-cdn.anthropic.com for Claude Sonnet 4.6 (adaptive thinking, max) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 4.6 on SWE-bench Multilingual
SWE-bench Multilingual — Mercor mini-swe-agent, 1000 stepsEffort: HighConfiguration: Mercor mini-swe-agent, 1000 steps, 3 hours78.1%mercor.com for Claude Sonnet 4.6 (high) on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 4.6 on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps
SWE-bench VerifiedEffort: MaxReported as: adaptive thinking, max79.6%www-cdn.anthropic.com for Claude Sonnet 4.6 (adaptive thinking, max) on SWE-bench Verified (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 4.6 on SWE-bench Verified
SWE-bench Verified — Epoch AI harnessConfiguration: Epoch AI harness75.2%epoch.ai for Claude Sonnet 4.6 on SWE-bench Verified — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Sonnet 4.6 on SWE-bench Verified — Epoch AI harness
SWE-bench Verified — Mercor mini-swe-agent, 1000 stepsEffort: HighConfiguration: Mercor mini-swe-agent, 1000 steps, 3 hours79.1%mercor.com for Claude Sonnet 4.6 (high) on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 4.6 on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps
SWE-bench Verified — Vals AI mini-swe-agentConfiguration: mini-swe-agent harness77.4%vals.ai for Claude Sonnet 4.6 on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 4.6 on SWE-bench Verified — Vals AI mini-swe-agent
Terminal-Bench 2.0Effort: MaxReported as: no thinking, max effort59.1%www-cdn.anthropic.com for Claude Sonnet 4.6 (no thinking, max effort) on Terminal-Bench 2.0 (opens in a new tab)Terminal-Bench AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 4.6 on Terminal-Bench 2.0
Terminal-Bench 2.0 — Vals AI Terminus 2Configuration: Terminus-2 harness59.6%vals.ai for Claude Sonnet 4.6 on Terminal-Bench 2.0 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 4.6 on Terminal-Bench 2.0 — Vals AI Terminus 2
Terminal-Bench 2.1 — Vals AI Terminus 2Configuration: Terminus-2 harness57.3%vals.ai for Claude Sonnet 4.6 on Terminal-Bench 2.1 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 4.6 on Terminal-Bench 2.1 — Vals AI Terminus 2
Toolathlon Original44.8%toolathlon.xyz for Claude Sonnet 4.6 on Toolathlon Original (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for Claude Sonnet 4.6 on Toolathlon Original
Vibe Code Bench 1.1 — Claude Code, October 2026 evaluationConfiguration: Claude Code harness55.8%vals.ai for Claude Sonnet 4.6 on Vibe Code Bench 1.1 — Claude Code, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 4.6 on Vibe Code Bench 1.1 — Claude Code, October 2026 evaluation
Vibe Code Bench 1.1 — OpenHands, October 2026 evaluationConfiguration: OpenHands harness51.5%vals.ai for Claude Sonnet 4.6 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 4.6 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation