OpenAI GPT-5.2 (none)75.0% sierra-tau-bench-public.s3.us-west-2.amazonaws.com for GPT-5.2 (none) on τ³-bench τ³ — Retail (opens in a new tab) Archived copy (opens in a new tab) Task success rate Reported May 26, 2026 Evaluated May 26, 2026 Benchmark leaderboard Sierra Independent Sierra Research Record for GPT-5.2 on τ³-bench τ³ — Retail 10012 Mistral AI Mistral Medium 3.5 (high)76.1% huggingface.co for Mistral Medium 3.5 (high) on τ³-bench τ³ — Retail (opens in a new tab) Task success rate Reported May 22, 2026 Model card Mistral AI Self-reported Record for Mistral Medium 3.5 on τ³-bench τ³ — Retail 90005 OpenAI GPT-5.2 (high)81.6% sierra-tau-bench-public.s3.us-west-2.amazonaws.com for GPT-5.2 (high) on τ³-bench τ³ — Retail (opens in a new tab) Archived copy (opens in a new tab) Task success rate Reported May 5, 2026 Evaluated May 5, 2026 Benchmark leaderboard Sierra Independent Sierra Research Record for GPT-5.2 on τ³-bench τ³ — Retail 10012 Anthropic Claude Opus 4.5 (high)79.6% sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Claude Opus 4.5 (high) on τ³-bench τ³ — Retail (opens in a new tab) Archived copy (opens in a new tab) Task success rate Reported May 5, 2026 Evaluated May 5, 2026 Benchmark leaderboard Sierra Independent Sierra Research Record for Claude Opus 4.5 on τ³-bench τ³ — Retail 20007 Alibaba (Tongyi) Qwen3.5-397B-A17B (enabled)84.4% sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Qwen3.5-397B-A17B (enabled) on τ³-bench τ³ — Retail (opens in a new tab) Archived copy (opens in a new tab) Task success rate Reported March 2, 2026 Evaluated February 27, 2026 Benchmark leaderboard Sierra Independent Sierra Research Record for Qwen3.5-397B-A17B on τ³-bench τ³ — Retail 130003 Z.ai GLM-5 (enabled)73.7% sierra-tau-bench-public.s3.us-west-2.amazonaws.com for GLM-5 (enabled) on τ³-bench τ³ — Retail (opens in a new tab) Archived copy (opens in a new tab) Task success rate Reported March 2, 2026 Evaluated February 27, 2026 Benchmark leaderboard Sierra Independent Sierra Research Record for GLM-5 on τ³-bench τ³ — Retail 150002 Google (DeepMind) Gemini 3 Pro (high)75.9% sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Gemini 3 Pro (high) on τ³-bench τ³ — Retail (opens in a new tab) Archived copy (opens in a new tab) Task success rate Reported March 2, 2026 Evaluated March 2, 2026 Benchmark leaderboard Sierra Independent Sierra Research Record for Gemini 3 Pro on τ³-bench τ³ — Retail 30008 Google (DeepMind) Gemini 3 Flash (high)76.8% sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Gemini 3 Flash (high) on τ³-bench τ³ — Retail (opens in a new tab) Archived copy (opens in a new tab) Task success rate Reported March 2, 2026 Evaluated March 2, 2026 Benchmark leaderboard Sierra Independent Sierra Research Record for Gemini 3 Flash on τ³-bench τ³ — Retail 30009 Anthropic Claude Sonnet 4.5 (enabled)72.4% sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Claude Sonnet 4.5 (enabled) on τ³-bench τ³ — Retail (opens in a new tab) Archived copy (opens in a new tab) Task success rate Reported February 26, 2026 Evaluated February 24, 2026 Benchmark leaderboard Sierra Independent Sierra Research Record for Claude Sonnet 4.5 on τ³-bench τ³ — Retail 20005