Results

113 results

AutomationBench 1.0.6 results
ProviderModelScoreSourceRegistry No.
OpenAIGPT-6 Astra (none)25.3%zapier.com for GPT-6 Astra (none) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-6 Astra on AutomationBench 1.0.610005
OpenAIGPT-5.40.2%zapier.com for GPT-5.4 on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.4 on AutomationBench 1.0.610007
OpenAIGPT-5.4 (medium)5.3%zapier.com for GPT-5.4 (medium) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.4 on AutomationBench 1.0.610007
OpenAIGPT-5.4 (low)1.5%zapier.com for GPT-5.4 (low) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.4 on AutomationBench 1.0.610007
OpenAIGPT-5.4 (high)10.1%zapier.com for GPT-5.4 (high) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.4 on AutomationBench 1.0.610007
OpenAIGPT-5.4 (xhigh)11.6%zapier.com for GPT-5.4 (xhigh) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.4 on AutomationBench 1.0.610007
OpenAIGPT-5.5 (low)2.6%zapier.com for GPT-5.5 (low) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.5 on AutomationBench 1.0.610008
OpenAIGPT-5.51.1%zapier.com for GPT-5.5 on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.5 on AutomationBench 1.0.610008
OpenAIGPT-5.5 (medium)9.0%zapier.com for GPT-5.5 (medium) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.5 on AutomationBench 1.0.610008
OpenAIGPT-5.5 (high)12.8%zapier.com for GPT-5.5 (high) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.5 on AutomationBench 1.0.610008
OpenAIGPT-5.5 (xhigh)16.6%zapier.com for GPT-5.5 (xhigh) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.5 on AutomationBench 1.0.610008
OpenAIGPT-5.6 Luna0.2%zapier.com for GPT-5.6 Luna on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.6 Luna on AutomationBench 1.0.610009
OpenAIGPT-5.6 Sol3.8%zapier.com for GPT-5.6 Sol on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.6 Sol on AutomationBench 1.0.610010
OpenAIGPT-5.6 Terra (xhigh)14.8%zapier.com for GPT-5.6 Terra (xhigh) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.6 Terra on AutomationBench 1.0.610011
OpenAIGPT-5.6 Terra (low)7.5%zapier.com for GPT-5.6 Terra (low) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.6 Terra on AutomationBench 1.0.610011
OpenAIGPT-5.6 Terra (max)23.6%zapier.com for GPT-5.6 Terra (max) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.6 Terra on AutomationBench 1.0.610011
OpenAIGPT-5.6 Terra0.8%zapier.com for GPT-5.6 Terra on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.6 Terra on AutomationBench 1.0.610011
OpenAIGPT-5.6 Terra (medium)8.1%zapier.com for GPT-5.6 Terra (medium) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.6 Terra on AutomationBench 1.0.610011
OpenAIGPT-5.6 Terra (high)11.7%zapier.com for GPT-5.6 Terra (high) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.6 Terra on AutomationBench 1.0.610011
OpenAIGPT-6 Luna (none)0.3%zapier.com for GPT-6 Luna (none) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-6 Luna on AutomationBench 1.0.610013
OpenAIGPT-6 Sol (none)9.1%zapier.com for GPT-6 Sol (none) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-6 Sol on AutomationBench 1.0.610014
DeepSeek AIDeepSeek-V4-Flash (max)18.1%zapier.com for DeepSeek-V4-Flash (max) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for DeepSeek-V4-Flash on AutomationBench 1.0.6110001
Moonshot AIKimi K2.62.6%zapier.com for Kimi K2.6 on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Kimi K2.6 on AutomationBench 1.0.6120002
Moonshot AIKimi K322.7%zapier.com for Kimi K3 on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Kimi K3 on AutomationBench 1.0.6120003
Alibaba (Tongyi)Qwen3.6-Plus (high)4.3%zapier.com for Qwen3.6-Plus (high) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Qwen3.6-Plus on AutomationBench 1.0.6130004
Alibaba (Tongyi)Qwen3.7-Plus3.7%zapier.com for Qwen3.7-Plus on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Qwen3.7-Plus on AutomationBench 1.0.6130007
MiniMaxMiniMax M2.7 (high)0.5%zapier.com for MiniMax M2.7 (high) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for MiniMax M2.7 on AutomationBench 1.0.6140002
MiniMaxMiniMax M3 (max)4.9%zapier.com for MiniMax M3 (max) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for MiniMax M3 on AutomationBench 1.0.6140003
Z.aiGLM-5.1 (max)6.2%zapier.com for GLM-5.1 (max) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GLM-5.1 on AutomationBench 1.0.6150003
OpenAIgpt-oss-120b (high)0.2%zapier.com for gpt-oss-120b (high) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for gpt-oss-120b on AutomationBench 1.0.615001
AnthropicClaude Fable 5.1 (max)22.4%zapier.com for Claude Fable 5.1 (max) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Fable 5.1 on AutomationBench 1.0.620004
AnthropicClaude Fable 5.1 (xhigh)21.3%zapier.com for Claude Fable 5.1 (xhigh) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Fable 5.1 on AutomationBench 1.0.620004
AnthropicClaude Haiku 4.50.5%zapier.com for Claude Haiku 4.5 on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Haiku 4.5 on AutomationBench 1.0.620006
AnthropicClaude Sonnet 4.6 (medium)3.7%zapier.com for Claude Sonnet 4.6 (medium) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Sonnet 4.6 on AutomationBench 1.0.620009
AnthropicClaude Sonnet 4.6 (low)2.9%zapier.com for Claude Sonnet 4.6 (low) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Sonnet 4.6 on AutomationBench 1.0.620009
AnthropicClaude Sonnet 4.6 (max)5.3%zapier.com for Claude Sonnet 4.6 (max) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Sonnet 4.6 on AutomationBench 1.0.620009
AnthropicClaude Sonnet 4.6 (high)5.0%zapier.com for Claude Sonnet 4.6 (high) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Sonnet 4.6 on AutomationBench 1.0.620009
AnthropicClaude Opus 4.7 (xhigh)9.7%zapier.com for Claude Opus 4.7 (xhigh) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Opus 4.7 on AutomationBench 1.0.620010
AnthropicClaude Opus 4.7 (low)5.5%zapier.com for Claude Opus 4.7 (low) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Opus 4.7 on AutomationBench 1.0.620010
AnthropicClaude Opus 4.7 (high)9.1%zapier.com for Claude Opus 4.7 (high) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Opus 4.7 on AutomationBench 1.0.620010
AnthropicClaude Opus 4.7 (max)13.4%zapier.com for Claude Opus 4.7 (max) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Opus 4.7 on AutomationBench 1.0.620010
AnthropicClaude Opus 4.7 (medium)6.9%zapier.com for Claude Opus 4.7 (medium) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Opus 4.7 on AutomationBench 1.0.620010
AnthropicClaude Opus 4.8 (medium)14.0%zapier.com for Claude Opus 4.8 (medium) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Opus 4.8 on AutomationBench 1.0.620011
AnthropicClaude Opus 4.8 (max)16.4%zapier.com for Claude Opus 4.8 (max) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Opus 4.8 on AutomationBench 1.0.620011
AnthropicClaude Opus 4.8 (low)13.6%zapier.com for Claude Opus 4.8 (low) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Opus 4.8 on AutomationBench 1.0.620011
AnthropicClaude Opus 4.8 (xhigh)16.9%zapier.com for Claude Opus 4.8 (xhigh) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Opus 4.8 on AutomationBench 1.0.620011
AnthropicClaude Opus 4.8 (high)16.1%zapier.com for Claude Opus 4.8 (high) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Opus 4.8 on AutomationBench 1.0.620011
AnthropicClaude Fable 5 (low)12.5%zapier.com for Claude Fable 5 (low) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Fable 5 on AutomationBench 1.0.620012
AnthropicClaude Fable 5 (xhigh)15.2%zapier.com for Claude Fable 5 (xhigh) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Fable 5 on AutomationBench 1.0.620012
AnthropicClaude Fable 5 (medium)13.7%zapier.com for Claude Fable 5 (medium) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Claude Fable 5 on AutomationBench 1.0.620012