Benchmarks

40 results across 23 benchmarks

Benchmark results for Claude Fable 5
BenchmarkScoreSource
APEX-Agents OriginalEffort: Max63.6%mercor.com for Claude Fable 5 (max) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5 on APEX-Agents Original
AutomationBench 1.0.6Effort: Low12.5%zapier.com for Claude Fable 5 (low) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Fable 5 on AutomationBench 1.0.6
AutomationBench 1.0.6Effort: Medium13.7%zapier.com for Claude Fable 5 (medium) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Fable 5 on AutomationBench 1.0.6
AutomationBench 1.0.6Effort: High16.1%zapier.com for Claude Fable 5 (high) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Fable 5 on AutomationBench 1.0.6
AutomationBench 1.0.6Effort: xHigh15.2%zapier.com for Claude Fable 5 (xhigh) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Fable 5 on AutomationBench 1.0.6
AutomationBench 1.0.6Effort: Max17.1%zapier.com for Claude Fable 5 (max) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Fable 5 on AutomationBench 1.0.6
BrowseComp 130-question subset — Mercor web research agentEffort: HighConfiguration: Mercor web research agent, 100 steps, 3 hours82.5%mercor.com for Claude Fable 5 (high) on BrowseComp 130-question subset — Mercor web research agent (opens in a new tab)Archived copy (opens in a new tab)BrowseComp AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5 on BrowseComp 130-question subset — Mercor web research agent
Chartography October 2026 leaderboardEffort: MaxReported as: Adaptive/Max34.8%surgehq.ai for Claude Fable 5 (Adaptive/Max) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Claude Fable 5 on Chartography October 2026 leaderboard
CharXiv Descriptive and reasoning — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent89.1%mercor.com for Claude Fable 5 (max) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)CharXiv AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5 on CharXiv Descriptive and reasoning — Mercor single-shot
DeepSWE 1.1Effort: xHigh70.0%deepswe.datacurve.ai for Claude Fable 5 (xhigh) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for Claude Fable 5 on DeepSWE 1.1
DeepSWE 1.1 — Mercor mini-swe-agent, 500 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 500 steps, 2 hours67.3%mercor.com for Claude Fable 5 (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps
Finance Agent Benchmark 2 — October 2026 evaluation56.3%vals.ai for Claude Fable 5 on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Finance Agent AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Fable 5 on Finance Agent Benchmark 2 — October 2026 evaluation
FrontierSWE 2 — October 2026 evaluationConfiguration: Proximus harness, 5 trials, 20-hour budget47.0%frontierswe.com for Claude Fable 5 on FrontierSWE 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)FrontierSWE ScoreReported Benchmark leaderboardProximalIndependentRecord for Claude Fable 5 on FrontierSWE 2 — October 2026 evaluation
GPQA Diamond — Epoch AI harnessEffort: LowConfiguration: Epoch AI harness78.8%epoch.ai for Claude Fable 5 (low) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Fable 5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Epoch AI harnessEffort: HighConfiguration: Epoch AI harness83.3%epoch.ai for Claude Fable 5 (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Fable 5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Epoch AI harnessEffort: MaxConfiguration: Epoch AI harness85.9%epoch.ai for Claude Fable 5 (max) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Fable 5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent85.0%mercor.com for Claude Fable 5 (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot
Humanity's Last Exam Text only — Mercor single-shotEffort: HighConfiguration: Mercor single-shot agent51.5%mercor.com for Claude Fable 5 (high) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5 on Humanity's Last Exam Text only — Mercor single-shot
Humanity's Last Exam Text only — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent46.5%mercor.com for Claude Fable 5 (max) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5 on Humanity's Last Exam Text only — Mercor single-shot
MCP Atlas Public, April 2026 update83.3%labs.scale.com for Claude Fable 5 on MCP Atlas Public, April 2026 update (opens in a new tab)Pass rateReported Benchmark leaderboardScale AIIndependentRecord for Claude Fable 5 on MCP Atlas Public, April 2026 update
MedXpertQA MM — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent76.2%mercor.com for Claude Fable 5 (max) on MedXpertQA MM — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5 on MedXpertQA MM — Mercor single-shot
MMLU-Pro Original — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent79.4%mercor.com for Claude Fable 5 (max) on MMLU-Pro Original — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5 on MMLU-Pro Original — Mercor single-shot
MMLU-Pro Original — Vals AI harnessConfiguration: Vals AI harness91.5%vals.ai for Claude Fable 5 on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Fable 5 on MMLU-Pro Original — Vals AI harness
MMMU-Pro 1,730 questions — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent72.7%mercor.com for Claude Fable 5 (max) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5 on MMMU-Pro 1,730 questions — Mercor single-shot
MMMU-Pro Vals AI harnessConfiguration: Vals AI harness89.3%vals.ai for Claude Fable 5 on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for Claude Fable 5 on MMMU-Pro Vals AI harness
OSWorld Verified85.0%www-cdn.anthropic.com for Claude Fable 5 on OSWorld Verified (opens in a new tab)OSWorld-Verified success rateReported System cardAnthropicSelf-reportedRecord for Claude Fable 5 on OSWorld Verified
Riemann-bench October 2026 leaderboardEffort: MaxReported as: Adaptive/Max60.0%surgehq.ai for Claude Fable 5 (Adaptive/Max) on Riemann-bench October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Riemann-bench Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Claude Fable 5 on Riemann-bench October 2026 leaderboard
SimpleQA Verified Original — Epoch AI harnessEffort: xHighConfiguration: Epoch AI harness70.7%epoch.ai for Claude Fable 5 (xhigh) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Claude Fable 5 on SimpleQA Verified Original — Epoch AI harness
SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 250 steps, 1 hour33.1%mercor.com for Claude Fable 5 (max) on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
SWE Atlas Codebase QnA — Public; Claude CodeEffort: xHighConfiguration: Claude Code harness39.0%labs.scale.com for Claude Fable 5 (xHigh) on SWE Atlas Codebase QnA — Public; Claude Code (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Claude Fable 5 on SWE Atlas Codebase QnA — Public; Claude Code
SWE Atlas Refactoring — Claude CodeEffort: xHighConfiguration: Claude Code harness54.8%labs.scale.com for Claude Fable 5 (xHigh) on SWE Atlas Refactoring — Claude Code (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Claude Fable 5 on SWE Atlas Refactoring — Claude Code
SWE-bench Multilingual — Mercor mini-swe-agent, 1000 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 1000 steps, 3 hours94.8%mercor.com for Claude Fable 5 (max) on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5 on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps
SWE-bench Verified95.0%www-cdn.anthropic.com for Claude Fable 5 on SWE-bench Verified (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Fable 5 on SWE-bench Verified
SWE-bench Verified — Mercor mini-swe-agent, 1000 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 1000 steps, 3 hours95.9%mercor.com for Claude Fable 5 (max) on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5 on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps
SWE-bench Verified — Vals AI mini-swe-agentConfiguration: mini-swe-agent harness95.0%vals.ai for Claude Fable 5 on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardVals AIIndependentRecord for Claude Fable 5 on SWE-bench Verified — Vals AI mini-swe-agent
Terminal-Bench 2.1 — mini-swe-agentEffort: HighConfiguration: mini-swe-agent harness84.3%www-cdn.anthropic.com for Claude Fable 5 (high) on Terminal-Bench 2.1 — mini-swe-agent (opens in a new tab)Terminal-Bench AccuracyReported System cardAnthropicSelf-reportedRecord for Claude Fable 5 on Terminal-Bench 2.1 — mini-swe-agent
Terminal-Bench 4.0 — Claude CodeEffort: MaxConfiguration: Claude Code harness44.6%tbench.ai for Claude Fable 5 (max) on Terminal-Bench 4.0 — Claude Code (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardTerminal-BenchIndependentTerminal-Bench TeamRecord for Claude Fable 5 on Terminal-Bench 4.0 — Claude Code
Vals Index 2.161.4%vals.ai for Claude Fable 5 on Vals Index 2.1 (opens in a new tab)Archived copy (opens in a new tab)Vals Index GDP-weighted AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Fable 5 on Vals Index 2.1
Vibe Code Bench 1.1 — OpenHands, October 2026 evaluationConfiguration: OpenHands harness90.4%vals.ai for Claude Fable 5 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for Claude Fable 5 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation
τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 gradingEffort: MaxConfiguration: AllTools retrieval39.7%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Claude Fable 5 (max) on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Claude Fable 5 on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading