Benchmark Registry

AutomationBench

AutomationBench results reported for 39 models across 1 version. Updated 2026-10-07.

Report an issue

Versions

1 version · Metric: Task pass rate

VersionReleasedModelsResults
AutomationBench 1.0.6LatestJuly 31, 202639113

Recently reported results: AutomationBench 1.0.6

Latest version: AutomationBench 1.0.6

ModelScoreSource
Claude Opus 4.7 (xhigh)9.7%zapier.comArchived copyTask pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord
GPT-5.40.2%zapier.comArchived copyTask pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord
Claude Fable 5 (low)12.5%zapier.comArchived copyTask pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord
Gemini 3.1 Pro (low)4.6%zapier.comArchived copyTask pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord
Claude Opus 5 (low)20.4%zapier.comArchived copyTask pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord