Results

16 results

τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading results
ProviderModelScoreSourceRegistry No.
OpenAIGPT-5.6 Sol (xhigh)46.9%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for GPT-5.6 Sol (xhigh) on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for GPT-5.6 Sol on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading10010
Moonshot AIKimi K3 (max)37.1%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Kimi K3 (max) on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Kimi K3 on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading120003
Z.aiGLM-5.2 (xhigh)37.1%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for GLM-5.2 (xhigh) on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for GLM-5.2 on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading150004
Thinking Machines LabInkling (max)25.0%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Inkling (max) on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Inkling on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading160001
AnthropicClaude Opus 4.8 (max)39.7%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Claude Opus 4.8 (max) on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Claude Opus 4.8 on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading20011
AnthropicClaude Fable 5 (max)39.7%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Claude Fable 5 (max) on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Claude Fable 5 on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading20012
AnthropicClaude Opus 5 (max)48.7%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Claude Opus 5 (max) on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Claude Opus 5 on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading20014
SpaceXAIGrok 4.5 (high)47.9%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Grok 4.5 (high) on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Grok 4.5 on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading40001
Meta AI (originally Facebook AI Research)Muse Spark 1.1 (xhigh)40.5%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Muse Spark 1.1 (xhigh) on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Muse Spark 1.1 on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading80002
AnthropicClaude Opus 4.7 (max)40.2%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Claude Opus 4.7 (max) on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Claude Opus 4.7 on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading20010
OpenAIGPT-5.5 (xhigh)44.6%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for GPT-5.5 (xhigh) on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for GPT-5.5 on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading10008
OpenAIGPT-5.4 (xhigh)39.4%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for GPT-5.4 (xhigh) on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for GPT-5.4 on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading10007
AnthropicClaude Opus 4.6 (max)27.3%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Claude Opus 4.6 (max) on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Claude Opus 4.6 on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading20008
OpenAIGPT-5.2 (high)32.2%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for GPT-5.2 (high) on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for GPT-5.2 on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading10012
AnthropicClaude Opus 4.5 (high)24.7%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Claude Opus 4.5 (high) on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Claude Opus 4.5 on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading20007
Google (DeepMind)Gemini 3.1 Pro (high)26.0%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Gemini 3.1 Pro (high) on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Gemini 3.1 Pro on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading30005