AutomationBench 1.0.6 0.5% zapier.com for Claude Haiku 4.5 on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Haiku 4.5 on AutomationBench 1.0.6 Finance Agent Benchmark 2 — October 2026 evaluation Reported as: thinking 31.0% vals.ai for Claude Haiku 4.5 (thinking) on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab) Archived copy (opens in a new tab) Finance Agent Accuracy Reported October 6, 2026 Benchmark leaderboard Vals AI Independent Record for Claude Haiku 4.5 on Finance Agent Benchmark 2 — October 2026 evaluation GPQA Diamond — Epoch AI harness Configuration: Epoch AI harness 60.5% epoch.ai for Claude Haiku 4.5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) GPQA Diamond Accuracy Reported October 7, 2026 Evaluated October 16, 2025 at 11:58 AM UTC Benchmark leaderboard Epoch AI Independent Record for Claude Haiku 4.5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness GPQA Diamond — Vals AI harness Reported as: thinking Configuration: Vals AI harness: mean of zero-shot and few-shot CoT 72.2% vals.ai for Claude Haiku 4.5 (thinking) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab) Archived copy (opens in a new tab) GPQA Diamond Accuracy Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Claude Haiku 4.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness HLAB October 2026 evaluation Reported as: thinking 0.8% vals.ai for Claude Haiku 4.5 (thinking) on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab) Archived copy (opens in a new tab) HLAB Task Pass Rate Reported October 6, 2026 Benchmark leaderboard Vals AI Independent Record for Claude Haiku 4.5 on Harvey's Legal Agent Benchmark October 2026 evaluation MCP Atlas Public, April 2026 update 40.2% labs.scale.com for Claude Haiku 4.5 on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for Claude Haiku 4.5 on MCP Atlas Public, April 2026 update MMLU-Pro Original — Vals AI harness Reported as: thinking Configuration: Vals AI harness 78.7% vals.ai for Claude Haiku 4.5 (thinking) on MMLU-Pro Original — Vals AI harness (opens in a new tab) Archived copy (opens in a new tab) Accuracy Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Claude Haiku 4.5 on MMLU-Pro Original — Vals AI harness MMMU-Pro Vals AI harness Reported as: thinking Configuration: Vals AI harness 46.1% vals.ai for Claude Haiku 4.5 (thinking) on MMMU-Pro Vals AI harness (opens in a new tab) Archived copy (opens in a new tab) MMMU-Pro accuracy Setting: Standard (4 options) Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Claude Haiku 4.5 on MMMU-Pro Vals AI harness SimpleQA Verified Original — Epoch AI harness Configuration: Epoch AI harness 13.2% epoch.ai for Claude Haiku 4.5 on SimpleQA Verified Original — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Accuracy Reported October 7, 2026 Evaluated August 10, 2026 at 9:26 PM UTC Benchmark leaderboard Epoch AI Independent Record for Claude Haiku 4.5 on SimpleQA Verified Original — Epoch AI harness SWE-bench Multilingual — mini-swe-agent Configuration: mini-swe-agent harness 64.7% github.com for Claude Haiku 4.5 on SWE-bench Multilingual — mini-swe-agent (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported February 13, 2026 Benchmark repository SWE-bench Independent SWE-bench Team Record for Claude Haiku 4.5 on SWE-bench Multilingual — mini-swe-agent SWE-bench Verified Reported as: extended thinking (128K) 73.3% anthropic.com for Claude Haiku 4.5 (extended thinking (128K)) on SWE-bench Verified (opens in a new tab) Resolved Tasks Reported October 15, 2025 Launch post Anthropic Self-reported Record for Claude Haiku 4.5 on SWE-bench Verified SWE-bench Verified — mini-swe-agent Effort: High Configuration: mini-swe-agent harness 66.6% github.com for Claude Haiku 4.5 (high) on SWE-bench Verified — mini-swe-agent (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported February 17, 2026 Benchmark repository SWE-bench Independent SWE-bench Team Record for Claude Haiku 4.5 on SWE-bench Verified — mini-swe-agent SWE-bench Verified — Vals AI mini-swe-agent Reported as: thinking Configuration: mini-swe-agent harness 66.6% vals.ai for Claude Haiku 4.5 (thinking) on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Claude Haiku 4.5 on SWE-bench Verified — Vals AI mini-swe-agent SWE-bench Pro Public — Scale AI SWE-Agent Configuration: SWE-Agent harness, 250 turns, uncapped cost 39.5% labs.scale.com for Claude Haiku 4.5 on SWE-bench Pro Public — Scale AI SWE-Agent (opens in a new tab) Archived copy (opens in a new tab) Public tasks resolved Reported October 7, 2026 Benchmark leaderboard Scale AI Independent Record for Claude Haiku 4.5 on SWE-bench Pro Public — Scale AI SWE-Agent Terminal-Bench 2.0 Effort: None Reported as: no thinking 40.2% anthropic.com for Claude Haiku 4.5 (no thinking) on Terminal-Bench 2.0 (opens in a new tab) Terminal-Bench Accuracy Reported October 15, 2025 Launch post Anthropic Self-reported Record for Claude Haiku 4.5 on Terminal-Bench 2.0 Terminal-Bench 2.0 Reported as: extended thinking (32K) 41.8% anthropic.com for Claude Haiku 4.5 (extended thinking (32K)) on Terminal-Bench 2.0 (opens in a new tab) Terminal-Bench Accuracy Reported October 15, 2025 Launch post Anthropic Self-reported Record for Claude Haiku 4.5 on Terminal-Bench 2.0 Terminal-Bench 2.0 — Vals AI Terminus 2 Reported as: thinking Configuration: Terminus-2 harness 38.2% vals.ai for Claude Haiku 4.5 (thinking) on Terminal-Bench 2.0 — Vals AI Terminus 2 (opens in a new tab) Archived copy (opens in a new tab) Terminal-Bench Accuracy Reported June 4, 2026 Benchmark leaderboard Vals AI Independent Record for Claude Haiku 4.5 on Terminal-Bench 2.0 — Vals AI Terminus 2 Terminal-Bench 2.1 — Vals AI Terminus 2 Reported as: thinking Configuration: Terminus-2 harness 43.8% vals.ai for Claude Haiku 4.5 (thinking) on Terminal-Bench 2.1 — Vals AI Terminus 2 (opens in a new tab) Archived copy (opens in a new tab) Terminal-Bench Accuracy Reported September 28, 2026 Benchmark leaderboard Vals AI Independent Record for Claude Haiku 4.5 on Terminal-Bench 2.1 — Vals AI Terminus 2 Toolathlon Original 26.2% toolathlon.xyz for Claude Haiku 4.5 on Toolathlon Original (opens in a new tab) Archived copy (opens in a new tab) Tasks completed Reported October 28, 2025 Benchmark leaderboard Toolathlon Independent Toolathlon Authors Record for Claude Haiku 4.5 on Toolathlon Original Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation Reported as: thinking Configuration: OpenHands harness 11.4% vals.ai for Claude Haiku 4.5 (thinking) on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab) Archived copy (opens in a new tab) Vibe Code Bench Score Reported October 6, 2026 Benchmark leaderboard Vals AI Independent Record for Claude Haiku 4.5 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation