Claude Fable 5 vs Claude Fable 5.1
27 shared benchmark contexts with reported scores and primary source links.
Claude Fable 5Claude Fable 5.1
Change models in the comparison toolShared benchmarks
27| Benchmark | Claude Fable 5 | Claude Fable 5.1 |
|---|---|---|
|
| |
Evaluation details for APEX-Agents OriginalThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for AutomationBench 1.0.6The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Fable 5 | ||
|
| |
Evaluation details for BrowseComp 130-question subset — Mercor web research agentThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for Chartography October 2026 leaderboardThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for CharXiv Descriptive and reasoning — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
DeepSWE 1.1Potentially non-equivalent: Evaluator sets differ. |
|
|
Potentially non-equivalent · Evaluation details for DeepSWE 1.1Evaluator sets differ. Evaluation methodology is not recorded by the registry. Claude Fable 5 Claude Fable 5.1 | ||
|
| |
Evaluation details for DeepSWE 1.1 — Mercor mini-swe-agent, 500 stepsThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for Finance Agent Benchmark 2 — October 2026 evaluationThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for FrontierSWE 2 — October 2026 evaluationThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for GPQA Diamond — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Fable 5 | ||
GPQAPotentially non-equivalent: Benchmark versions differ. Evaluator sets differ. |
|
|
Potentially non-equivalent · Evaluation details for GPQABenchmark versions differ. Evaluator sets differ. Evaluation methodology is not recorded by the registry. Claude Fable 5 | ||
|
| |
Evaluation details for Humanity's Last Exam Text only — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Fable 5 | ||
|
| |
Evaluation details for MCP Atlas Public, April 2026 updateThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for MedXpertQA MM — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for MMLU-Pro Original — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for MMLU-Pro Original — Vals AI harnessThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for MMMU-Pro 1,730 questions — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for MMMU-Pro Vals AI harnessThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Fable 5 Claude Fable 5.1 | ||
|
| |
Evaluation details for Riemann-bench October 2026 leaderboardThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SimpleQA Verified Original — Epoch AI harnessThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 stepsThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SWE Atlas Codebase QnA — Public; Claude CodeThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SWE Atlas Refactoring — Claude CodeThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SWE-bench Multilingual — Mercor mini-swe-agent, 1000 stepsThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SWE-bench Verified — Mercor mini-swe-agent, 1000 stepsThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for Terminal-Bench 4.0 — Claude CodeThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Claude Fable 5.1 | ||
|
| |
Evaluation details for Vibe Code Bench 1.1 — OpenHands, October 2026 evaluationThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||