Results

6 results

SWE-bench Pro Private — Scale AI SWE-Agent results
ProviderModelScoreSourceRegistry No.
OpenAIGPT-5.223.8%labs.scale.com for GPT-5.2 on SWE-bench Pro Private — Scale AI SWE-Agent (opens in a new tab)Archived copy (opens in a new tab)Public tasks resolvedReported Benchmark leaderboardScale AIIndependentRecord for GPT-5.2 on SWE-bench Pro Private — Scale AI SWE-Agent10012
OpenAIGPT-514.9%labs.scale.com for GPT-5 on SWE-bench Pro Private — Scale AI SWE-Agent (opens in a new tab)Archived copy (opens in a new tab)Public tasks resolvedReported Benchmark leaderboardScale AIIndependentRecord for GPT-5 on SWE-bench Pro Private — Scale AI SWE-Agent10018
AnthropicClaude Sonnet 49.1%labs.scale.com for Claude Sonnet 4 on SWE-bench Pro Private — Scale AI SWE-Agent (opens in a new tab)Archived copy (opens in a new tab)Public tasks resolvedReported Benchmark leaderboardScale AIIndependentRecord for Claude Sonnet 4 on SWE-bench Pro Private — Scale AI SWE-Agent20003
AnthropicClaude Opus 4.523.4%labs.scale.com for Claude Opus 4.5 on SWE-bench Pro Private — Scale AI SWE-Agent (opens in a new tab)Archived copy (opens in a new tab)Public tasks resolvedReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.5 on SWE-bench Pro Private — Scale AI SWE-Agent20007
AnthropicClaude Opus 4.117.8%labs.scale.com for Claude Opus 4.1 on SWE-bench Pro Private — Scale AI SWE-Agent (opens in a new tab)Archived copy (opens in a new tab)Public tasks resolvedReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.1 on SWE-bench Pro Private — Scale AI SWE-Agent20017
Google (DeepMind)Gemini 3 Pro17.9%labs.scale.com for Gemini 3 Pro on SWE-bench Pro Private — Scale AI SWE-Agent (opens in a new tab)Archived copy (opens in a new tab)Public tasks resolvedReported Benchmark leaderboardScale AIIndependentRecord for Gemini 3 Pro on SWE-bench Pro Private — Scale AI SWE-Agent30008