OpenAI GPT-6 Astra (none)25.3% zapier.com for GPT-6 Astra (none) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for GPT-6 Astra on AutomationBench 1.0.6 10005 OpenAI GPT-5.4 0.2% zapier.com for GPT-5.4 on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for GPT-5.4 on AutomationBench 1.0.6 10007 OpenAI GPT-5.4 (medium)5.3% zapier.com for GPT-5.4 (medium) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for GPT-5.4 on AutomationBench 1.0.6 10007 OpenAI GPT-5.4 (low)1.5% zapier.com for GPT-5.4 (low) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for GPT-5.4 on AutomationBench 1.0.6 10007 OpenAI GPT-5.4 (high)10.1% zapier.com for GPT-5.4 (high) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for GPT-5.4 on AutomationBench 1.0.6 10007 OpenAI GPT-5.4 (xhigh)11.6% zapier.com for GPT-5.4 (xhigh) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for GPT-5.4 on AutomationBench 1.0.6 10007 OpenAI GPT-5.5 (low)2.6% zapier.com for GPT-5.5 (low) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for GPT-5.5 on AutomationBench 1.0.6 10008 OpenAI GPT-5.5 1.1% zapier.com for GPT-5.5 on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for GPT-5.5 on AutomationBench 1.0.6 10008 OpenAI GPT-5.5 (medium)9.0% zapier.com for GPT-5.5 (medium) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for GPT-5.5 on AutomationBench 1.0.6 10008 OpenAI GPT-5.5 (high)12.8% zapier.com for GPT-5.5 (high) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for GPT-5.5 on AutomationBench 1.0.6 10008 OpenAI GPT-5.5 (xhigh)16.6% zapier.com for GPT-5.5 (xhigh) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for GPT-5.5 on AutomationBench 1.0.6 10008 OpenAI GPT-5.6 Luna 0.2% zapier.com for GPT-5.6 Luna on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for GPT-5.6 Luna on AutomationBench 1.0.6 10009 OpenAI GPT-5.6 Sol 3.8% zapier.com for GPT-5.6 Sol on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for GPT-5.6 Sol on AutomationBench 1.0.6 10010 OpenAI GPT-5.6 Terra (xhigh)14.8% zapier.com for GPT-5.6 Terra (xhigh) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for GPT-5.6 Terra on AutomationBench 1.0.6 10011 OpenAI GPT-5.6 Terra (low)7.5% zapier.com for GPT-5.6 Terra (low) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for GPT-5.6 Terra on AutomationBench 1.0.6 10011 OpenAI GPT-5.6 Terra (max)23.6% zapier.com for GPT-5.6 Terra (max) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for GPT-5.6 Terra on AutomationBench 1.0.6 10011 OpenAI GPT-5.6 Terra 0.8% zapier.com for GPT-5.6 Terra on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for GPT-5.6 Terra on AutomationBench 1.0.6 10011 OpenAI GPT-5.6 Terra (medium)8.1% zapier.com for GPT-5.6 Terra (medium) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for GPT-5.6 Terra on AutomationBench 1.0.6 10011 OpenAI GPT-5.6 Terra (high)11.7% zapier.com for GPT-5.6 Terra (high) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for GPT-5.6 Terra on AutomationBench 1.0.6 10011 OpenAI GPT-6 Luna (none)0.3% zapier.com for GPT-6 Luna (none) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for GPT-6 Luna on AutomationBench 1.0.6 10013 OpenAI GPT-6 Sol (none)9.1% zapier.com for GPT-6 Sol (none) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for GPT-6 Sol on AutomationBench 1.0.6 10014 DeepSeek AI DeepSeek-V4-Flash (max)18.1% zapier.com for DeepSeek-V4-Flash (max) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for DeepSeek-V4-Flash on AutomationBench 1.0.6 110001 Moonshot AI Kimi K2.6 2.6% zapier.com for Kimi K2.6 on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Kimi K2.6 on AutomationBench 1.0.6 120002 Moonshot AI Kimi K3 22.7% zapier.com for Kimi K3 on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Kimi K3 on AutomationBench 1.0.6 120003 Alibaba (Tongyi) Qwen3.6-Plus (high)4.3% zapier.com for Qwen3.6-Plus (high) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Qwen3.6-Plus on AutomationBench 1.0.6 130004 Alibaba (Tongyi) Qwen3.7-Plus 3.7% zapier.com for Qwen3.7-Plus on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Qwen3.7-Plus on AutomationBench 1.0.6 130007 MiniMax MiniMax M2.7 (high)0.5% zapier.com for MiniMax M2.7 (high) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for MiniMax M2.7 on AutomationBench 1.0.6 140002 MiniMax MiniMax M3 (max)4.9% zapier.com for MiniMax M3 (max) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for MiniMax M3 on AutomationBench 1.0.6 140003 Z.ai GLM-5.1 (max)6.2% zapier.com for GLM-5.1 (max) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for GLM-5.1 on AutomationBench 1.0.6 150003 OpenAI gpt-oss-120b (high)0.2% zapier.com for gpt-oss-120b (high) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for gpt-oss-120b on AutomationBench 1.0.6 15001 Anthropic Claude Fable 5.1 (max)22.4% zapier.com for Claude Fable 5.1 (max) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Fable 5.1 on AutomationBench 1.0.6 20004 Anthropic Claude Fable 5.1 (xhigh)21.3% zapier.com for Claude Fable 5.1 (xhigh) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Fable 5.1 on AutomationBench 1.0.6 20004 Anthropic Claude Haiku 4.5 0.5% zapier.com for Claude Haiku 4.5 on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Haiku 4.5 on AutomationBench 1.0.6 20006 Anthropic Claude Sonnet 4.6 (medium)3.7% zapier.com for Claude Sonnet 4.6 (medium) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Sonnet 4.6 on AutomationBench 1.0.6 20009 Anthropic Claude Sonnet 4.6 (low)2.9% zapier.com for Claude Sonnet 4.6 (low) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Sonnet 4.6 on AutomationBench 1.0.6 20009 Anthropic Claude Sonnet 4.6 (max)5.3% zapier.com for Claude Sonnet 4.6 (max) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Sonnet 4.6 on AutomationBench 1.0.6 20009 Anthropic Claude Sonnet 4.6 (high)5.0% zapier.com for Claude Sonnet 4.6 (high) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Sonnet 4.6 on AutomationBench 1.0.6 20009 Anthropic Claude Opus 4.7 (xhigh)9.7% zapier.com for Claude Opus 4.7 (xhigh) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Opus 4.7 on AutomationBench 1.0.6 20010 Anthropic Claude Opus 4.7 (low)5.5% zapier.com for Claude Opus 4.7 (low) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Opus 4.7 on AutomationBench 1.0.6 20010 Anthropic Claude Opus 4.7 (high)9.1% zapier.com for Claude Opus 4.7 (high) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Opus 4.7 on AutomationBench 1.0.6 20010 Anthropic Claude Opus 4.7 (max)13.4% zapier.com for Claude Opus 4.7 (max) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Opus 4.7 on AutomationBench 1.0.6 20010 Anthropic Claude Opus 4.7 (medium)6.9% zapier.com for Claude Opus 4.7 (medium) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Opus 4.7 on AutomationBench 1.0.6 20010 Anthropic Claude Opus 4.8 (medium)14.0% zapier.com for Claude Opus 4.8 (medium) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Opus 4.8 on AutomationBench 1.0.6 20011 Anthropic Claude Opus 4.8 (max)16.4% zapier.com for Claude Opus 4.8 (max) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Opus 4.8 on AutomationBench 1.0.6 20011 Anthropic Claude Opus 4.8 (low)13.6% zapier.com for Claude Opus 4.8 (low) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Opus 4.8 on AutomationBench 1.0.6 20011 Anthropic Claude Opus 4.8 (xhigh)16.9% zapier.com for Claude Opus 4.8 (xhigh) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Opus 4.8 on AutomationBench 1.0.6 20011 Anthropic Claude Opus 4.8 (high)16.1% zapier.com for Claude Opus 4.8 (high) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Opus 4.8 on AutomationBench 1.0.6 20011 Anthropic Claude Fable 5 (low)12.5% zapier.com for Claude Fable 5 (low) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Fable 5 on AutomationBench 1.0.6 20012 Anthropic Claude Fable 5 (xhigh)15.2% zapier.com for Claude Fable 5 (xhigh) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Fable 5 on AutomationBench 1.0.6 20012 Anthropic Claude Fable 5 (medium)13.7% zapier.com for Claude Fable 5 (medium) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for Claude Fable 5 on AutomationBench 1.0.6 20012