Results

9 results

τ³-bench τ³ — Retail results
ProviderModelScoreSourceRegistry No.
OpenAIGPT-5.2 (none)75.0%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for GPT-5.2 (none) on τ³-bench τ³ — Retail (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for GPT-5.2 on τ³-bench τ³ — Retail10012
Mistral AIMistral Medium 3.5 (high)76.1%huggingface.co for Mistral Medium 3.5 (high) on τ³-bench τ³ — Retail (opens in a new tab)Task success rateReported Model cardMistral AISelf-reportedRecord for Mistral Medium 3.5 on τ³-bench τ³ — Retail90005
OpenAIGPT-5.2 (high)81.6%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for GPT-5.2 (high) on τ³-bench τ³ — Retail (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for GPT-5.2 on τ³-bench τ³ — Retail10012
AnthropicClaude Opus 4.5 (high)79.6%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Claude Opus 4.5 (high) on τ³-bench τ³ — Retail (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Claude Opus 4.5 on τ³-bench τ³ — Retail20007
Alibaba (Tongyi)Qwen3.5-397B-A17B (enabled)84.4%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Qwen3.5-397B-A17B (enabled) on τ³-bench τ³ — Retail (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Qwen3.5-397B-A17B on τ³-bench τ³ — Retail130003
Z.aiGLM-5 (enabled)73.7%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for GLM-5 (enabled) on τ³-bench τ³ — Retail (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for GLM-5 on τ³-bench τ³ — Retail150002
Google (DeepMind)Gemini 3 Pro (high)75.9%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Gemini 3 Pro (high) on τ³-bench τ³ — Retail (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Gemini 3 Pro on τ³-bench τ³ — Retail30008
Google (DeepMind)Gemini 3 Flash (high)76.8%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Gemini 3 Flash (high) on τ³-bench τ³ — Retail (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Gemini 3 Flash on τ³-bench τ³ — Retail30009
AnthropicClaude Sonnet 4.5 (enabled)72.4%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Claude Sonnet 4.5 (enabled) on τ³-bench τ³ — Retail (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Claude Sonnet 4.5 on τ³-bench τ³ — Retail20005