Benchmarks

80 results across 26 benchmarks

Benchmark results for Claude Fable 5.1
BenchmarkScoreSource
APEX-Agents OriginalEffort: High59.7%mercor.com for Claude Fable 5.1 (high) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5.1 on APEX-Agents Original
APEX-Agents OriginalEffort: Max68.6%mercor.com for Claude Fable 5.1 (max) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5.1 on APEX-Agents Original
AutomationBench 1.0.6Effort: xHigh21.3%zapier.com for Claude Fable 5.1 (xhigh) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Fable 5.1 on AutomationBench 1.0.6
AutomationBench 1.0.6Effort: Max22.4%zapier.com for Claude Fable 5.1 (max) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Fable 5.1 on AutomationBench 1.0.6
BrowseComp 130-question subset — Mercor web research agentEffort: HighConfiguration: Mercor web research agent, 100 steps, 3 hours78.3%mercor.com for Claude Fable 5.1 (high) on BrowseComp 130-question subset — Mercor web research agent (opens in a new tab)Archived copy (opens in a new tab)BrowseComp AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5.1 on BrowseComp 130-question subset — Mercor web research agent
BrowseComp 130-question subset — Mercor web research agentEffort: MaxConfiguration: Mercor web research agent, 100 steps, 3 hours85.2%mercor.com for Claude Fable 5.1 (max) on BrowseComp 130-question subset — Mercor web research agent (opens in a new tab)Archived copy (opens in a new tab)BrowseComp AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5.1 on BrowseComp 130-question subset — Mercor web research agent
Chartography October 2026 leaderboardEffort: MaxReported as: Adaptive/Max46.2%surgehq.ai for Claude Fable 5.1 (Adaptive/Max) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Claude Fable 5.1 on Chartography October 2026 leaderboard
CharXiv Descriptive and reasoning — Mercor single-shotEffort: HighConfiguration: Mercor single-shot agent94.1%mercor.com for Claude Fable 5.1 (high) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)CharXiv AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5.1 on CharXiv Descriptive and reasoning — Mercor single-shot
CharXiv Descriptive and reasoning — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent95.1%mercor.com for Claude Fable 5.1 (max) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)CharXiv AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5.1 on CharXiv Descriptive and reasoning — Mercor single-shot
CursorBench 3.2.0Effort: Low66.2%anthropic.com for Claude Fable 5.1 (low) on CursorBench 3.2.0 (opens in a new tab)CursorBench AccuracyReported Launch postAnthropicSelf-reportedCursorRecord for Claude Fable 5.1 on CursorBench 3.2.0
CursorBench 3.2.0Effort: Medium68.0%anthropic.com for Claude Fable 5.1 (medium) on CursorBench 3.2.0 (opens in a new tab)CursorBench AccuracyReported Launch postAnthropicSelf-reportedCursorRecord for Claude Fable 5.1 on CursorBench 3.2.0
CursorBench 3.2.0Effort: High69.4%anthropic.com for Claude Fable 5.1 (high) on CursorBench 3.2.0 (opens in a new tab)CursorBench AccuracyReported Launch postAnthropicSelf-reportedCursorRecord for Claude Fable 5.1 on CursorBench 3.2.0
CursorBench 3.2.0Effort: xHigh72.8%anthropic.com for Claude Fable 5.1 (xhigh) on CursorBench 3.2.0 (opens in a new tab)CursorBench AccuracyReported Launch postAnthropicSelf-reportedCursorRecord for Claude Fable 5.1 on CursorBench 3.2.0
CursorBench 3.2.0Effort: Max73.4%anthropic.com for Claude Fable 5.1 (max) on CursorBench 3.2.0 (opens in a new tab)CursorBench AccuracyReported Launch postAnthropicSelf-reportedCursorRecord for Claude Fable 5.1 on CursorBench 3.2.0
CursorBench 4.0Effort: Low45.1%cursor.com for Claude Fable 5.1 (low) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Claude Fable 5.1 on CursorBench 4.0
CursorBench 4.0Effort: Medium46.8%cursor.com for Claude Fable 5.1 (medium) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Claude Fable 5.1 on CursorBench 4.0
CursorBench 4.0Effort: High49.2%cursor.com for Claude Fable 5.1 (high) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Claude Fable 5.1 on CursorBench 4.0
CursorBench 4.0Effort: xHigh51.6%cursor.com for Claude Fable 5.1 (xhigh) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Claude Fable 5.1 on CursorBench 4.0
CursorBench 4.0Effort: Max51.8%cursor.com for Claude Fable 5.1 (max) on CursorBench 4.0 (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Claude Fable 5.1 on CursorBench 4.0
CWE-bench 1 — Claude CodeEffort: HighConfiguration: Claude Code harness58.0%cwe-bench.com for Claude Fable 5.1 (high) on CWE-bench 1 — Claude Code (opens in a new tab)Archived copy (opens in a new tab)CWE-bench Programmatic Pass@1Reported Benchmark leaderboardCollinear AIIndependentRecord for Claude Fable 5.1 on CWE-bench 1 — Claude Code
DeepSWE 1.1Effort: Max67.4%www-cdn.anthropic.com for Claude Fable 5.1 (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported System cardAnthropicSelf-reportedRecord for Claude Fable 5.1 on DeepSWE 1.1
DeepSWE 1.1 — Mercor mini-swe-agent, 500 stepsEffort: HighConfiguration: Mercor mini-swe-agent, 500 steps, 2 hours67.3%mercor.com for Claude Fable 5.1 (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5.1 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps
DeepSWE 1.1 — Mercor mini-swe-agent, 500 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 500 steps, 2 hours64.9%mercor.com for Claude Fable 5.1 (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5.1 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps
Finance Agent Benchmark 2 — October 2026 evaluation58.9%vals.ai for Claude Fable 5.1 on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Finance Agent AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Fable 5.1 on Finance Agent Benchmark 2 — October 2026 evaluation
FrontierSWE 2 — October 2026 evaluationConfiguration: Proximus harness, 5 trials, 20-hour budget56.3%frontierswe.com for Claude Fable 5.1 on FrontierSWE 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)FrontierSWE ScoreReported Benchmark leaderboardProximalIndependentRecord for Claude Fable 5.1 on FrontierSWE 2 — October 2026 evaluation
Global MMLU OriginalEffort: Max94.0%www-cdn.anthropic.com for Claude Fable 5.1 (max) on Global MMLU Original (opens in a new tab)Average accuracyReported System cardAnthropicSelf-reportedRecord for Claude Fable 5.1 on Global MMLU Original
GPQA Diamond — Mercor single-shotEffort: HighConfiguration: Mercor single-shot agent85.2%mercor.com for Claude Fable 5.1 (high) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5.1 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot
GPQA Diamond — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent91.4%mercor.com for Claude Fable 5.1 (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5.1 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot
GPQA Diamond — Vals AI harnessConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT93.4%vals.ai for Claude Fable 5.1 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Fable 5.1 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
HLAB October 2026 evaluation6.7%vals.ai for Claude Fable 5.1 on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)HLAB Task Pass RateReported Benchmark leaderboardVals AIIndependentRecord for Claude Fable 5.1 on Harvey's Legal Agent Benchmark October 2026 evaluation
Humanity's Last Exam Full set — No toolsEffort: LowConfiguration: No tools53.2%anthropic.com for Claude Fable 5.1 (low) on Humanity's Last Exam Full set — No tools (opens in a new tab)Humanity's Last Exam AccuracyReported Launch postAnthropicSelf-reportedRecord for Claude Fable 5.1 on Humanity's Last Exam Full set — No tools
Humanity's Last Exam Full set — No toolsEffort: MediumConfiguration: No tools55.9%anthropic.com for Claude Fable 5.1 (medium) on Humanity's Last Exam Full set — No tools (opens in a new tab)Humanity's Last Exam AccuracyReported Launch postAnthropicSelf-reportedRecord for Claude Fable 5.1 on Humanity's Last Exam Full set — No tools
Humanity's Last Exam Full set — No toolsEffort: HighConfiguration: No tools58.0%anthropic.com for Claude Fable 5.1 (high) on Humanity's Last Exam Full set — No tools (opens in a new tab)Humanity's Last Exam AccuracyReported Launch postAnthropicSelf-reportedRecord for Claude Fable 5.1 on Humanity's Last Exam Full set — No tools
Humanity's Last Exam Full set — No toolsEffort: xHighConfiguration: No tools60.4%anthropic.com for Claude Fable 5.1 (xhigh) on Humanity's Last Exam Full set — No tools (opens in a new tab)Humanity's Last Exam AccuracyReported Launch postAnthropicSelf-reportedRecord for Claude Fable 5.1 on Humanity's Last Exam Full set — No tools
Humanity's Last Exam Full set — No toolsReported as: no toolsConfiguration: No tools60.9%anthropic.com for Claude Fable 5.1 (no tools) on Humanity's Last Exam Full set — No tools (opens in a new tab)Humanity's Last Exam AccuracyReported Launch postAnthropicSelf-reportedRecord for Claude Fable 5.1 on Humanity's Last Exam Full set — No tools
Humanity's Last Exam Full set — Scale AI evaluationEffort: xHigh46.5%labs.scale.com for Claude Fable 5.1 (xhigh) on Humanity's Last Exam Full set — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Fable 5.1 on Humanity's Last Exam Full set — Scale AI evaluation
Humanity's Last Exam Full set — With toolsReported as: with toolsConfiguration: With tools65.0%anthropic.com for Claude Fable 5.1 (with tools) on Humanity's Last Exam Full set — With tools (opens in a new tab)Humanity's Last Exam AccuracyReported Launch postAnthropicSelf-reportedRecord for Claude Fable 5.1 on Humanity's Last Exam Full set — With tools
Humanity's Last Exam Text only — Mercor single-shotEffort: HighConfiguration: Mercor single-shot agent53.1%mercor.com for Claude Fable 5.1 (high) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5.1 on Humanity's Last Exam Text only — Mercor single-shot
Humanity's Last Exam Text only — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent54.6%mercor.com for Claude Fable 5.1 (max) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5.1 on Humanity's Last Exam Text only — Mercor single-shot
Humanity's Last Exam Text only — Scale AI evaluationEffort: xHigh46.8%labs.scale.com for Claude Fable 5.1 (xhigh) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Fable 5.1 on Humanity's Last Exam Text only — Scale AI evaluation
MCP Atlas Public, April 2026 update87.2%labs.scale.com for Claude Fable 5.1 on MCP Atlas Public, April 2026 update (opens in a new tab)Pass rateReported Benchmark leaderboardScale AIIndependentRecord for Claude Fable 5.1 on MCP Atlas Public, April 2026 update
MedXpertQA MM — Mercor single-shotEffort: HighConfiguration: Mercor single-shot agent79.7%mercor.com for Claude Fable 5.1 (high) on MedXpertQA MM — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5.1 on MedXpertQA MM — Mercor single-shot
MedXpertQA MM — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent83.7%mercor.com for Claude Fable 5.1 (max) on MedXpertQA MM — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5.1 on MedXpertQA MM — Mercor single-shot
MMLU-Pro Original — Mercor single-shotEffort: HighConfiguration: Mercor single-shot agent91.5%mercor.com for Claude Fable 5.1 (high) on MMLU-Pro Original — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5.1 on MMLU-Pro Original — Mercor single-shot
MMLU-Pro Original — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent93.0%mercor.com for Claude Fable 5.1 (max) on MMLU-Pro Original — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5.1 on MMLU-Pro Original — Mercor single-shot
MMLU-Pro Original — Vals AI harnessConfiguration: Vals AI harness92.4%vals.ai for Claude Fable 5.1 on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Fable 5.1 on MMLU-Pro Original — Vals AI harness
MMMU-Pro 1,730 questions — Mercor single-shotEffort: HighConfiguration: Mercor single-shot agent83.9%mercor.com for Claude Fable 5.1 (high) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5.1 on MMMU-Pro 1,730 questions — Mercor single-shot
MMMU-Pro 1,730 questions — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent86.1%mercor.com for Claude Fable 5.1 (max) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5.1 on MMMU-Pro 1,730 questions — Mercor single-shot
MMMU-Pro Vals AI harnessConfiguration: Vals AI harness90.6%vals.ai for Claude Fable 5.1 on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for Claude Fable 5.1 on MMMU-Pro Vals AI harness
MILU OriginalEffort: Max93.0%www-cdn.anthropic.com for Claude Fable 5.1 (max) on Multi-task Indic Language Understanding Benchmark Original (opens in a new tab)Average accuracyReported System cardAnthropicSelf-reportedRecord for Claude Fable 5.1 on Multi-task Indic Language Understanding Benchmark Original