Results

6 results

SWE Atlas Refactoring — mini-swe-agent results
ProviderModelScoreSourceRegistry No.
Moonshot AIKimi K2.521.0%labs.scale.com for Kimi K2.5 on SWE Atlas Refactoring — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Kimi K2.5 on SWE Atlas Refactoring — mini-swe-agent120001
MiniMaxMiniMax M2.519.5%labs.scale.com for MiniMax M2.5 on SWE Atlas Refactoring — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for MiniMax M2.5 on SWE Atlas Refactoring — mini-swe-agent140001
Z.aiGLM-524.2%labs.scale.com for GLM-5 on SWE Atlas Refactoring — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for GLM-5 on SWE Atlas Refactoring — mini-swe-agent150002
Z.aiGLM-5.242.4%labs.scale.com for GLM-5.2 on SWE Atlas Refactoring — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for GLM-5.2 on SWE Atlas Refactoring — mini-swe-agent150004
Google (DeepMind)Gemini 3.8 Flash44.8%labs.scale.com for Gemini 3.8 Flash on SWE Atlas Refactoring — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Gemini 3.8 Flash on SWE Atlas Refactoring — mini-swe-agent30004
Google (DeepMind)Gemini 3 Flash10.0%labs.scale.com for Gemini 3 Flash on SWE Atlas Refactoring — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Gemini 3 Flash on SWE Atlas Refactoring — mini-swe-agent30009