Benchmarks

50 results across 24 benchmarks

Benchmark results for Claude Sonnet 5.5
BenchmarkScoreSource
APEX-Agents OriginalEffort: Medium44.6%mercor.com for Claude Sonnet 5.5 (medium) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5.5 on APEX-Agents Original
APEX-Agents OriginalEffort: Max75.5%mercor.com for Claude Sonnet 5.5 (max) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5.5 on APEX-Agents Original
AutomationBench 1.0.6Effort: Max44.7%anthropic.com for Claude Sonnet 5.5 (max) on AutomationBench 1.0.6 (opens in a new tab)Task pass rateReported System cardAnthropicSelf-reportedZapier AutomationBench TeamRecord for Claude Sonnet 5.5 on AutomationBench 1.0.6
BrowseComp 130-question subset — Mercor web research agentEffort: MaxConfiguration: Mercor web research agent, 100 steps, 3 hours86.6%mercor.com for Claude Sonnet 5.5 (max) on BrowseComp 130-question subset — Mercor web research agent (opens in a new tab)Archived copy (opens in a new tab)BrowseComp AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5.5 on BrowseComp 130-question subset — Mercor web research agent
CharXiv Descriptive and reasoning — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent96.1%mercor.com for Claude Sonnet 5.5 (max) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)CharXiv AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5.5 on CharXiv Descriptive and reasoning — Mercor single-shot
CursorBench 4.0Effort: Low35.8%cursor.com for Claude Sonnet 5.5 (low) on CursorBench 4.0 (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Claude Sonnet 5.5 on CursorBench 4.0
CursorBench 4.0Effort: Medium39.2%cursor.com for Claude Sonnet 5.5 (medium) on CursorBench 4.0 (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Claude Sonnet 5.5 on CursorBench 4.0
CursorBench 4.0Effort: High47.8%cursor.com for Claude Sonnet 5.5 (high) on CursorBench 4.0 (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Claude Sonnet 5.5 on CursorBench 4.0
CursorBench 4.0Effort: xHigh53.1%cursor.com for Claude Sonnet 5.5 (xhigh) on CursorBench 4.0 (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Claude Sonnet 5.5 on CursorBench 4.0
CursorBench 4.0Effort: Max55.5%cursor.com for Claude Sonnet 5.5 (max) on CursorBench 4.0 (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Claude Sonnet 5.5 on CursorBench 4.0
DeepSWE 1.1Effort: Max71.0%anthropic.com for Claude Sonnet 5.5 (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on DeepSWE 1.1
DeepSWE 1.1 — Mercor mini-swe-agent, 500 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 500 steps, 2 hours70.5%mercor.com for Claude Sonnet 5.5 (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5.5 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps
Finance Agent Benchmark 2 — October 2026 evaluation58.1%vals.ai for Claude Sonnet 5.5 on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Finance Agent AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 5.5 on Finance Agent Benchmark 2 — October 2026 evaluation
FrontierSWE 2 — October 2026 evaluationConfiguration: Proximus harness, 5 trials, 20-hour budget61.9%frontierswe.com for Claude Sonnet 5.5 on FrontierSWE 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)FrontierSWE ScoreReported Benchmark leaderboardProximalIndependentRecord for Claude Sonnet 5.5 on FrontierSWE 2 — October 2026 evaluation
Global MMLU OriginalEffort: Max92.1%anthropic.com for Claude Sonnet 5.5 (max) on Global MMLU Original (opens in a new tab)Average accuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on Global MMLU Original
GPQA Diamond — Epoch AI harnessEffort: MaxConfiguration: Epoch AI harness95.6%epoch.ai for Claude Sonnet 5.5 (max) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Sonnet 5.5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent95.2%mercor.com for Claude Sonnet 5.5 (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5.5 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot
HLAB October 2026 evaluation2.9%vals.ai for Claude Sonnet 5.5 on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)HLAB Task Pass RateReported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 5.5 on Harvey's Legal Agent Benchmark October 2026 evaluation
Humanity's Last Exam Full set — No toolsEffort: LowConfiguration: No tools41.4%anthropic.com for Claude Sonnet 5.5 (low) on Humanity's Last Exam Full set — No tools (opens in a new tab)Humanity's Last Exam AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on Humanity's Last Exam Full set — No tools
Humanity's Last Exam Full set — No toolsEffort: MediumConfiguration: No tools43.2%anthropic.com for Claude Sonnet 5.5 (medium) on Humanity's Last Exam Full set — No tools (opens in a new tab)Humanity's Last Exam AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on Humanity's Last Exam Full set — No tools
Humanity's Last Exam Full set — No toolsEffort: HighConfiguration: No tools47.9%anthropic.com for Claude Sonnet 5.5 (high) on Humanity's Last Exam Full set — No tools (opens in a new tab)Humanity's Last Exam AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on Humanity's Last Exam Full set — No tools
Humanity's Last Exam Full set — No toolsEffort: xHighConfiguration: No tools53.0%anthropic.com for Claude Sonnet 5.5 (xhigh) on Humanity's Last Exam Full set — No tools (opens in a new tab)Humanity's Last Exam AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on Humanity's Last Exam Full set — No tools
Humanity's Last Exam Full set — No toolsEffort: MaxConfiguration: No tools56.9%anthropic.com for Claude Sonnet 5.5 (max) on Humanity's Last Exam Full set — No tools (opens in a new tab)Humanity's Last Exam AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on Humanity's Last Exam Full set — No tools
Humanity's Last Exam Full set — With toolsEffort: LowConfiguration: With tools47.6%anthropic.com for Claude Sonnet 5.5 (low) on Humanity's Last Exam Full set — With tools (opens in a new tab)Humanity's Last Exam AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on Humanity's Last Exam Full set — With tools
Humanity's Last Exam Full set — With toolsEffort: MediumConfiguration: With tools50.5%anthropic.com for Claude Sonnet 5.5 (medium) on Humanity's Last Exam Full set — With tools (opens in a new tab)Humanity's Last Exam AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on Humanity's Last Exam Full set — With tools
Humanity's Last Exam Full set — With toolsEffort: HighConfiguration: With tools56.7%anthropic.com for Claude Sonnet 5.5 (high) on Humanity's Last Exam Full set — With tools (opens in a new tab)Humanity's Last Exam AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on Humanity's Last Exam Full set — With tools
Humanity's Last Exam Full set — With toolsEffort: xHighConfiguration: With tools62.0%anthropic.com for Claude Sonnet 5.5 (xhigh) on Humanity's Last Exam Full set — With tools (opens in a new tab)Humanity's Last Exam AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on Humanity's Last Exam Full set — With tools
Humanity's Last Exam Full set — With toolsEffort: MaxConfiguration: With tools64.5%anthropic.com for Claude Sonnet 5.5 (max) on Humanity's Last Exam Full set — With tools (opens in a new tab)Humanity's Last Exam AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on Humanity's Last Exam Full set — With tools
MedXpertQA MM — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent80.7%mercor.com for Claude Sonnet 5.5 (max) on MedXpertQA MM — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5.5 on MedXpertQA MM — Mercor single-shot
MMLU-Pro Original — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent91.0%mercor.com for Claude Sonnet 5.5 (max) on MMLU-Pro Original — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5.5 on MMLU-Pro Original — Mercor single-shot
MMMU-Pro 1,730 questions — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent85.8%mercor.com for Claude Sonnet 5.5 (max) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5.5 on MMMU-Pro 1,730 questions — Mercor single-shot
MILU OriginalEffort: Max91.6%anthropic.com for Claude Sonnet 5.5 (max) on Multi-task Indic Language Understanding Benchmark Original (opens in a new tab)Average accuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on Multi-task Indic Language Understanding Benchmark Original
SimpleQA Verified Original — Epoch AI harnessEffort: MaxConfiguration: Epoch AI harness46.5%epoch.ai for Claude Sonnet 5.5 (max) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Sonnet 5.5 on SimpleQA Verified Original — Epoch AI harness
SpatialBench VerifiedEffort: Max72.5%anthropic.com for Claude Sonnet 5.5 (max) on SpatialBench Verified (opens in a new tab)Task-pass accuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on SpatialBench Verified
SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 250 steps, 1 hour50.3%mercor.com for Claude Sonnet 5.5 (max) on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5.5 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
SWE-bench MultilingualEffort: Max90.3%anthropic.com for Claude Sonnet 5.5 (max) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on SWE-bench Multilingual
SWE-bench Multilingual — Mercor mini-swe-agent, 1000 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 1000 steps, 3 hours90.9%mercor.com for Claude Sonnet 5.5 (max) on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5.5 on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps
SWE-bench Verified — Mercor mini-swe-agent, 1000 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 1000 steps, 3 hours96.7%mercor.com for Claude Sonnet 5.5 (max) on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5.5 on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps
SWE-bench Pro PublicEffort: Max81.3%anthropic.com for Claude Sonnet 5.5 (max) on SWE-bench Pro Public (opens in a new tab)Public tasks resolvedReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on SWE-bench Pro Public
Terminal-Bench 2.1 — Vals AI Terminus 2Configuration: Terminus-2 harness83.1%vals.ai for Claude Sonnet 5.5 on Terminal-Bench 2.1 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 5.5 on Terminal-Bench 2.1 — Vals AI Terminus 2
Terminal-Bench 4.0Effort: Low20.0%anthropic.com for Claude Sonnet 5.5 (low) on Terminal-Bench 4.0 (opens in a new tab)Terminal-Bench AccuracyReported Launch postAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on Terminal-Bench 4.0
Terminal-Bench 4.0Effort: Medium28.8%anthropic.com for Claude Sonnet 5.5 (medium) on Terminal-Bench 4.0 (opens in a new tab)Terminal-Bench AccuracyReported Launch postAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on Terminal-Bench 4.0
Terminal-Bench 4.0Effort: High43.0%anthropic.com for Claude Sonnet 5.5 (high) on Terminal-Bench 4.0 (opens in a new tab)Terminal-Bench AccuracyReported Launch postAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on Terminal-Bench 4.0
Terminal-Bench 4.0Effort: xHigh61.5%anthropic.com for Claude Sonnet 5.5 (xhigh) on Terminal-Bench 4.0 (opens in a new tab)Terminal-Bench AccuracyReported Launch postAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on Terminal-Bench 4.0
Terminal-Bench 4.0Effort: Max70.6%anthropic.com for Claude Sonnet 5.5 (max) on Terminal-Bench 4.0 (opens in a new tab)Terminal-Bench AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on Terminal-Bench 4.0
Terminal-Bench 4.0 — Claude CodeEffort: MaxConfiguration: Claude Code harness61.8%tbench.ai for Claude Sonnet 5.5 (max) on Terminal-Bench 4.0 — Claude Code (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardTerminal-BenchIndependentTerminal-Bench TeamRecord for Claude Sonnet 5.5 on Terminal-Bench 4.0 — Claude Code
Terminal-Bench 4.0 — Mercor mini-swe-agentEffort: MaxConfiguration: Mercor mini-swe-agent, 1000 steps, 8 hours51.5%mercor.com for Claude Sonnet 5.5 (max) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5.5 on Terminal-Bench 4.0 — Mercor mini-swe-agent
Terminal-Bench Science 0.1Effort: Max59.9%anthropic.com for Claude Sonnet 5.5 (max) on Terminal-Bench Science 0.1 (opens in a new tab)Terminal-Bench AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on Terminal-Bench Science 0.1
Toolathlon VerifiedEffort: Max77.8%anthropic.com for Claude Sonnet 5.5 (max) on Toolathlon Verified (opens in a new tab)Tasks completedReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on Toolathlon Verified
Vibe Code Bench 1.1 — OpenHands, October 2026 evaluationConfiguration: OpenHands harness92.4%vals.ai for Claude Sonnet 5.5 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 5.5 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation