Results

31 results

DeepSWE 1.1 results
ProviderModelScoreSourceRegistry No.
OpenAIGPT-6.1 Sol (high)75.2%Source for GPT-6.1 Sol (high) on DeepSWE 1.1 (opens in a new tab)10015
OpenAIGPT-6.1 Sol (low)64.4%Source for GPT-6.1 Sol (low) on DeepSWE 1.1 (opens in a new tab)10015
OpenAIGPT-6.1 Sol (medium)73.0%Source for GPT-6.1 Sol (medium) on DeepSWE 1.1 (opens in a new tab)10015
OpenAIGPT-6.1 Sol (xhigh)71.9%Source for GPT-6.1 Sol (xhigh) on DeepSWE 1.1 (opens in a new tab)10015
OpenAIGPT-6.1 Sol (max)71.9%Source for GPT-6.1 Sol (max) on DeepSWE 1.1 (opens in a new tab)10015
AnthropicClaude Sonnet 5.5 (max)71.0%Source for Claude Sonnet 5.5 (max) on DeepSWE 1.1 (opens in a new tab)20016
OpenAIGPT-6 Astra (xhigh)74.0%Source for GPT-6 Astra (xhigh) on DeepSWE 1.1 (opens in a new tab)10005
OpenAIGPT-5.6 Sol (max)73.0%Source for GPT-5.6 Sol (max) on DeepSWE 1.1 (opens in a new tab)10010
OpenAIGPT-6 Luna (max)66.6%Source for GPT-6 Luna (max) on DeepSWE 1.1 (opens in a new tab)10013
OpenAIGPT-6 Sol (max)68.8%Source for GPT-6 Sol (max) on DeepSWE 1.1 (opens in a new tab)10014
DeepSeek AIDeepSeek-V4-Flash (max)53.0%Source for DeepSeek-V4-Flash (max) on DeepSWE 1.1 (opens in a new tab)110001
DeepSeek AIDeepSeek-V4-Pro (max)63.0%Source for DeepSeek-V4-Pro (max) on DeepSWE 1.1 (opens in a new tab)110002
Moonshot AIKimi K3 (max)69.0%Source for Kimi K3 (max) on DeepSWE 1.1 (opens in a new tab)120003
Alibaba (Tongyi)Qwen3.8-Max (xhigh)57.0%Source for Qwen3.8-Max (xhigh) on DeepSWE 1.1 (opens in a new tab)130008
Z.aiGLM-5.2 (max)44.0%Source for GLM-5.2 (max) on DeepSWE 1.1 (opens in a new tab)150004
Z.aiGLM-5.3 (max)69.0%Source for GLM-5.3 (max) on DeepSWE 1.1 (opens in a new tab)150005
Z.aiGLM-5.3-Flash (max)63.0%Source for GLM-5.3-Flash (max) on DeepSWE 1.1 (opens in a new tab)150006
AnthropicClaude Opus 4.8 (max)59.0%Source for Claude Opus 4.8 (max) on DeepSWE 1.1 (opens in a new tab)20011
AnthropicClaude Fable 5 (xhigh)70.0%Source for Claude Fable 5 (xhigh) on DeepSWE 1.1 (opens in a new tab)20012
AnthropicClaude Sonnet 5 (max)54.0%Source for Claude Sonnet 5 (max) on DeepSWE 1.1 (opens in a new tab)20013
AnthropicClaude Opus 5 (max)74.0%Source for Claude Opus 5 (max) on DeepSWE 1.1 (opens in a new tab)20014
Google (DeepMind)Gemini 3.7 Flash (medium)65.0%Source for Gemini 3.7 Flash (medium) on DeepSWE 1.1 (opens in a new tab)30010
SpaceXAIGrok 4.6 (medium)67.0%Source for Grok 4.6 (medium) on DeepSWE 1.1 (opens in a new tab)40002
SpaceXAIGrok 4.7 (high)71.0%Source for Grok 4.7 (high) on DeepSWE 1.1 (opens in a new tab)40003
Google (DeepMind)Gemini 3.8 Flash (high)73.7%Source for Gemini 3.8 Flash (high) on DeepSWE 1.1 (opens in a new tab)30004
Google (DeepMind)Gemini 3.7 Flash (high)65.3%Source for Gemini 3.7 Flash (high) on DeepSWE 1.1 (opens in a new tab)30010
SpaceXAIGrok 4.6 (high)65.9%Source for Grok 4.6 (high) on DeepSWE 1.1 (opens in a new tab)40002
Google (DeepMind)Gemini 3.6 Flash (high)49.0%Source for Gemini 3.6 Flash (high) on DeepSWE 1.1 (opens in a new tab)30007
OpenAIGPT-5.6 Luna67.2%Source for GPT-5.6 Luna on DeepSWE 1.1 (opens in a new tab)10009
OpenAIGPT-5.6 Sol72.7%Source for GPT-5.6 Sol on DeepSWE 1.1 (opens in a new tab)10010
OpenAIGPT-5.6 Terra69.6%Source for GPT-5.6 Terra on DeepSWE 1.1 (opens in a new tab)10011