Results

7 results

SWE Atlas Codebase QnA — Public; Claude Code results
ProviderModelScoreSourceRegistry No.
AnthropicClaude Fable 5.1 (xHigh)60.0%labs.scale.com for Claude Fable 5.1 (xHigh) on SWE Atlas Codebase QnA — Public; Claude Code (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Claude Fable 5.1 on SWE Atlas Codebase QnA — Public; Claude Code20004
AnthropicClaude Opus 4.633.3%labs.scale.com for Claude Opus 4.6 on SWE Atlas Codebase QnA — Public; Claude Code (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.6 on SWE Atlas Codebase QnA — Public; Claude Code20008
AnthropicClaude Sonnet 4.631.2%labs.scale.com for Claude Sonnet 4.6 on SWE Atlas Codebase QnA — Public; Claude Code (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Claude Sonnet 4.6 on SWE Atlas Codebase QnA — Public; Claude Code20009
AnthropicClaude Opus 4.740.3%labs.scale.com for Claude Opus 4.7 on SWE Atlas Codebase QnA — Public; Claude Code (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.7 on SWE Atlas Codebase QnA — Public; Claude Code20010
AnthropicClaude Opus 4.8 (xhigh)57.3%labs.scale.com for Claude Opus 4.8 (xhigh) on SWE Atlas Codebase QnA — Public; Claude Code (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.8 on SWE Atlas Codebase QnA — Public; Claude Code20011
AnthropicClaude Fable 5 (xHigh)39.0%labs.scale.com for Claude Fable 5 (xHigh) on SWE Atlas Codebase QnA — Public; Claude Code (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Claude Fable 5 on SWE Atlas Codebase QnA — Public; Claude Code20012
AnthropicClaude Opus 5 (xHigh)63.2%labs.scale.com for Claude Opus 5 (xHigh) on SWE Atlas Codebase QnA — Public; Claude Code (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 5 on SWE Atlas Codebase QnA — Public; Claude Code20014