Results

5 results

SWE Atlas Codebase QnA — Public; Codex results
ProviderModelScoreSourceRegistry No.
OpenAIGPT-6 Astra (xHigh)59.1%labs.scale.com for GPT-6 Astra (xHigh) on SWE Atlas Codebase QnA — Public; Codex (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for GPT-6 Astra on SWE Atlas Codebase QnA — Public; Codex10005
OpenAIGPT-5.3-Codex (xHigh)32.6%labs.scale.com for GPT-5.3-Codex (xHigh) on SWE Atlas Codebase QnA — Public; Codex (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for GPT-5.3-Codex on SWE Atlas Codebase QnA — Public; Codex10006
OpenAIGPT-5.4 (xHigh)40.8%labs.scale.com for GPT-5.4 (xHigh) on SWE Atlas Codebase QnA — Public; Codex (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for GPT-5.4 on SWE Atlas Codebase QnA — Public; Codex10007
OpenAIGPT-5.5 (xHigh)45.4%labs.scale.com for GPT-5.5 (xHigh) on SWE Atlas Codebase QnA — Public; Codex (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for GPT-5.5 on SWE Atlas Codebase QnA — Public; Codex10008
OpenAIGPT-5.6 Sol (xHigh)46.0%labs.scale.com for GPT-5.6 Sol (xHigh) on SWE Atlas Codebase QnA — Public; Codex (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for GPT-5.6 Sol on SWE Atlas Codebase QnA — Public; Codex10010