OpenAI GPT-5.4 (xhigh)70.6% labs.scale.com for GPT-5.4 (xhigh) on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for GPT-5.4 on MCP Atlas Public, April 2026 update 10007 OpenAI GPT-5.5 (xhigh)75.3% labs.scale.com for GPT-5.5 (xhigh) on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for GPT-5.5 on MCP Atlas Public, April 2026 update 10008 OpenAI GPT-5.6 Sol (sol)81.8% labs.scale.com for GPT-5.6 Sol (sol) on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for GPT-5.6 Sol on MCP Atlas Public, April 2026 update 10010 Moonshot AI Kimi K2.5 64.4% labs.scale.com for Kimi K2.5 on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for Kimi K2.5 on MCP Atlas Public, April 2026 update 120001 Moonshot AI Kimi K3 (max)82.3% labs.scale.com for Kimi K3 (max) on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for Kimi K3 on MCP Atlas Public, April 2026 update 120003 Z.ai GLM-4.7 58.1% labs.scale.com for GLM-4.7 on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for GLM-4.7 on MCP Atlas Public, April 2026 update 150001 Z.ai GLM-5.1 75.6% labs.scale.com for GLM-5.1 on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for GLM-5.1 on MCP Atlas Public, April 2026 update 150003 Z.ai GLM-5.2 77.8% labs.scale.com for GLM-5.2 on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for GLM-5.2 on MCP Atlas Public, April 2026 update 150004 Z.ai GLM-5.3 84.2% labs.scale.com for GLM-5.3 on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for GLM-5.3 on MCP Atlas Public, April 2026 update 150005 Thinking Machines Lab Inkling (xHigh)76.0% labs.scale.com for Inkling (xHigh) on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for Inkling on MCP Atlas Public, April 2026 update 160001 Thinking Machines Lab Inkling-Small 79.2% labs.scale.com for Inkling-Small on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for Inkling-Small on MCP Atlas Public, April 2026 update 160002 Anthropic Claude Fable 5.1 87.2% labs.scale.com for Claude Fable 5.1 on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for Claude Fable 5.1 on MCP Atlas Public, April 2026 update 20004 Anthropic Claude Sonnet 4.5 (thinking)59.5% labs.scale.com for Claude Sonnet 4.5 (thinking) on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for Claude Sonnet 4.5 on MCP Atlas Public, April 2026 update 20005 Anthropic Claude Haiku 4.5 40.2% labs.scale.com for Claude Haiku 4.5 on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for Claude Haiku 4.5 on MCP Atlas Public, April 2026 update 20006 Anthropic Claude Opus 4.5 (high)69.8% labs.scale.com for Claude Opus 4.5 (high) on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for Claude Opus 4.5 on MCP Atlas Public, April 2026 update 20007 Anthropic Claude Opus 4.6 (max)76.8% labs.scale.com for Claude Opus 4.6 (max) on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for Claude Opus 4.6 on MCP Atlas Public, April 2026 update 20008 Anthropic Claude Sonnet 4.6 69.5% labs.scale.com for Claude Sonnet 4.6 on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for Claude Sonnet 4.6 on MCP Atlas Public, April 2026 update 20009 Anthropic Claude Opus 4.7 (max)79.1% labs.scale.com for Claude Opus 4.7 (max) on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for Claude Opus 4.7 on MCP Atlas Public, April 2026 update 20010 Anthropic Claude Opus 4.8 (max)82.2% labs.scale.com for Claude Opus 4.8 (max) on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for Claude Opus 4.8 on MCP Atlas Public, April 2026 update 20011 Anthropic Claude Fable 5 83.3% labs.scale.com for Claude Fable 5 on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for Claude Fable 5 on MCP Atlas Public, April 2026 update 20012 Anthropic Claude Opus 5 (xhigh)85.8% labs.scale.com for Claude Opus 5 (xhigh) on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for Claude Opus 5 on MCP Atlas Public, April 2026 update 20014 Google (DeepMind) Gemini 3.1 Pro (high)78.2% labs.scale.com for Gemini 3.1 Pro (high) on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for Gemini 3.1 Pro on MCP Atlas Public, April 2026 update 30005 Google (DeepMind) Gemini 3.5 Flash (high)83.6% labs.scale.com for Gemini 3.5 Flash (high) on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for Gemini 3.5 Flash on MCP Atlas Public, April 2026 update 30006 Google (DeepMind) Gemini 3 Pro 70.3% labs.scale.com for Gemini 3 Pro on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for Gemini 3 Pro on MCP Atlas Public, April 2026 update 30008 Google (DeepMind) Gemini 3 Flash 62.0% labs.scale.com for Gemini 3 Flash on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for Gemini 3 Flash on MCP Atlas Public, April 2026 update 30009 NVIDIA NVIDIA Nemotron 3 Ultra 550B-A55B (thinking)63.1% labs.scale.com for NVIDIA Nemotron 3 Ultra 550B-A55B (thinking) on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for NVIDIA Nemotron 3 Ultra 550B-A55B on MCP Atlas Public, April 2026 update 60003 Meta AI (originally Facebook AI Research) Muse Spark 82.2% labs.scale.com for Muse Spark on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for Muse Spark on MCP Atlas Public, April 2026 update 80001 Meta AI (originally Facebook AI Research) Muse Spark 1.1 88.1% labs.scale.com for Muse Spark 1.1 on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for Muse Spark 1.1 on MCP Atlas Public, April 2026 update 80002 OpenAI GPT-5.2 (xhigh)67.6% labs.scale.com for GPT-5.2 (xhigh) on MCP Atlas Public, April 2026 update (opens in a new tab) Archived copy (opens in a new tab) Pass rate Reported September 21, 2026 Benchmark leaderboard Scale AI Independent Record for GPT-5.2 on MCP Atlas Public, April 2026 update 10012