Results

9 results

τ³-bench τ³ — Airline results
ProviderModelScoreSourceRegistry No.
OpenAIGPT-5.2 (none)52.5%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for GPT-5.2 (none) on τ³-bench τ³ — Airline (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for GPT-5.2 on τ³-bench τ³ — Airline10012
Mistral AIMistral Medium 3.5 (high)72.0%huggingface.co for Mistral Medium 3.5 (high) on τ³-bench τ³ — Airline (opens in a new tab)Task success rateReported Model cardMistral AISelf-reportedRecord for Mistral Medium 3.5 on τ³-bench τ³ — Airline90005
OpenAIGPT-5.2 (high)83.0%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for GPT-5.2 (high) on τ³-bench τ³ — Airline (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for GPT-5.2 on τ³-bench τ³ — Airline10012
AnthropicClaude Opus 4.5 (high)84.0%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Claude Opus 4.5 (high) on τ³-bench τ³ — Airline (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Claude Opus 4.5 on τ³-bench τ³ — Airline20007
Alibaba (Tongyi)Qwen3.5-397B-A17B (enabled)81.5%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Qwen3.5-397B-A17B (enabled) on τ³-bench τ³ — Airline (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Qwen3.5-397B-A17B on τ³-bench τ³ — Airline130003
Z.aiGLM-5 (enabled)82.5%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for GLM-5 (enabled) on τ³-bench τ³ — Airline (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for GLM-5 on τ³-bench τ³ — Airline150002
Google (DeepMind)Gemini 3 Pro (high)80.5%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Gemini 3 Pro (high) on τ³-bench τ³ — Airline (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Gemini 3 Pro on τ³-bench τ³ — Airline30008
Google (DeepMind)Gemini 3 Flash (high)82.5%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Gemini 3 Flash (high) on τ³-bench τ³ — Airline (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Gemini 3 Flash on τ³-bench τ³ — Airline30009
AnthropicClaude Sonnet 4.5 (enabled)72.0%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Claude Sonnet 4.5 (enabled) on τ³-bench τ³ — Airline (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Claude Sonnet 4.5 on τ³-bench τ³ — Airline20005