OpenAI GPT-6 Astra (max)72.0% mercor.com for GPT-6 Astra (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for GPT-6 Astra on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 10005 OpenAI GPT-5.4 (xhigh)49.0% mercor.com for GPT-5.4 (xhigh) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for GPT-5.4 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 10007 OpenAI GPT-5.5 (xhigh)66.1% mercor.com for GPT-5.5 (xhigh) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for GPT-5.5 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 10008 OpenAI GPT-5.6 Luna (max)64.3% mercor.com for GPT-5.6 Luna (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for GPT-5.6 Luna on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 10009 OpenAI GPT-5.6 Sol (max)70.5% mercor.com for GPT-5.6 Sol (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for GPT-5.6 Sol on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 10010 OpenAI GPT-5.6 Terra (max)70.2% mercor.com for GPT-5.6 Terra (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for GPT-5.6 Terra on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 10011 OpenAI GPT-6 Luna (max)67.0% mercor.com for GPT-6 Luna (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for GPT-6 Luna on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 10013 OpenAI GPT-6 Sol (max)70.5% mercor.com for GPT-6 Sol (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for GPT-6 Sol on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 10014 OpenAI GPT-6.1 Sol (max)72.3% mercor.com for GPT-6.1 Sol (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for GPT-6.1 Sol on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 10015 DeepSeek AI DeepSeek-V4-Pro (max)9.1% mercor.com for DeepSeek-V4-Pro (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for DeepSeek-V4-Pro on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 110002 DeepSeek AI DeepSeek-V3.2 0.6% mercor.com for DeepSeek-V3.2 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for DeepSeek-V3.2 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 110003 Moonshot AI Kimi K3 (max)66.4% mercor.com for Kimi K3 (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Kimi K3 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 120003 Alibaba (Tongyi) Qwen3.5-397B-A17B 0.0% mercor.com for Qwen3.5-397B-A17B on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Qwen3.5-397B-A17B on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 130003 Alibaba (Tongyi) Qwen3.8-Max (xhigh)53.1% mercor.com for Qwen3.8-Max (xhigh) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Qwen3.8-Max on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 130008 MiniMax MiniMax M2.7 (high)0.0% mercor.com for MiniMax M2.7 (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for MiniMax M2.7 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 140002 MiniMax MiniMax M3 (high)9.1% mercor.com for MiniMax M3 (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for MiniMax M3 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 140003 Z.ai GLM-5 2.1% mercor.com for GLM-5 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for GLM-5 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 150002 Z.ai GLM-5.1 18.9% mercor.com for GLM-5.1 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for GLM-5.1 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 150003 Z.ai GLM-5.2 (max)38.9% mercor.com for GLM-5.2 (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for GLM-5.2 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 150004 Z.ai GLM-5.3 (max)70.5% mercor.com for GLM-5.3 (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for GLM-5.3 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 150005 Z.ai GLM-5.3-Flash (max)42.5% mercor.com for GLM-5.3-Flash (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for GLM-5.3-Flash on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 150006 OpenAI gpt-oss-120b (high)0.0% mercor.com for gpt-oss-120b (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for gpt-oss-120b on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 15001 Thinking Machines Lab Inkling (high)5.0% mercor.com for Inkling (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Inkling on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 160001 Anthropic Claude Fable 5.1 (max)64.9% mercor.com for Claude Fable 5.1 (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Fable 5.1 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 20004 Anthropic Claude Fable 5.1 (high)67.3% mercor.com for Claude Fable 5.1 (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Fable 5.1 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 20004 Anthropic Claude Opus 4.6 (max)31.9% mercor.com for Claude Opus 4.6 (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Opus 4.6 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 20008 Anthropic Claude Sonnet 4.6 (high)34.2% mercor.com for Claude Sonnet 4.6 (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Sonnet 4.6 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 20009 Anthropic Claude Opus 4.7 (max)49.3% mercor.com for Claude Opus 4.7 (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Opus 4.7 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 20010 Anthropic Claude Opus 4.8 (max)59.6% mercor.com for Claude Opus 4.8 (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Opus 4.8 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 20011 Anthropic Claude Fable 5 (max)67.3% mercor.com for Claude Fable 5 (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Fable 5 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 20012 Anthropic Claude Sonnet 5 (max)49.6% mercor.com for Claude Sonnet 5 (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Sonnet 5 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 20013 Anthropic Claude Opus 5 (max)71.4% mercor.com for Claude Opus 5 (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Opus 5 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 20014 Anthropic Claude Opus 5 (xhigh)70.2% mercor.com for Claude Opus 5 (xhigh) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Opus 5 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 20014 Anthropic Claude Opus 5.5 (max)72.3% mercor.com for Claude Opus 5.5 (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Opus 5.5 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 20015 Anthropic Claude Sonnet 5.5 (max)70.5% mercor.com for Claude Sonnet 5.5 (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Claude Sonnet 5.5 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 20016 Google (DeepMind) Gemini 3.8 Flash (high)71.4% mercor.com for Gemini 3.8 Flash (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Gemini 3.8 Flash on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 30004 Google (DeepMind) Gemini 3.1 Pro (high)7.7% mercor.com for Gemini 3.1 Pro (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Gemini 3.1 Pro on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 30005 Google (DeepMind) Gemini 3.5 Flash (high)36.6% mercor.com for Gemini 3.5 Flash (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Gemini 3.5 Flash on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 30006 Google (DeepMind) Gemini 3.6 Flash (high)49.3% mercor.com for Gemini 3.6 Flash (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Gemini 3.6 Flash on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 30007 Google (DeepMind) Gemini 3.7 Flash (high)65.5% mercor.com for Gemini 3.7 Flash (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Gemini 3.7 Flash on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 30010 Google (DeepMind) Gemma 4 31B Instruct 0.0% mercor.com for Gemma 4 31B Instruct on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Gemma 4 31B Instruct on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 35002 SpaceXAI Grok 4.5 (high)49.3% mercor.com for Grok 4.5 (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Grok 4.5 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 40001 SpaceXAI Grok 4.6 (high)63.7% mercor.com for Grok 4.6 (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Grok 4.6 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 40002 SpaceXAI Grok 4.6 (xhigh)24.8% mercor.com for Grok 4.6 (xhigh) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Grok 4.6 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 40002 SpaceXAI Grok 4.7 (xhigh)33.3% mercor.com for Grok 4.7 (xhigh) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Grok 4.7 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 40003 NVIDIA NVIDIA Nemotron 3 Ultra 550B-A55B (high)0.6% mercor.com for NVIDIA Nemotron 3 Ultra 550B-A55B (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for NVIDIA Nemotron 3 Ultra 550B-A55B on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 60003 Meta AI (originally Facebook AI Research) Muse Spark 1.1 (xhigh)40.4% mercor.com for Muse Spark 1.1 (xhigh) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Muse Spark 1.1 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps 80002