Results

63 results

DeepSWE 1.1 results
ProviderModelScoreSourceRegistry No.
OpenAIGPT-6.1 Sol (high)75.2%openai.com for GPT-6.1 Sol (high) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6.1 Sol on DeepSWE 1.110015
OpenAIGPT-6.1 Sol (low)64.4%openai.com for GPT-6.1 Sol (low) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6.1 Sol on DeepSWE 1.110015
OpenAIGPT-6.1 Sol (medium)73.0%openai.com for GPT-6.1 Sol (medium) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6.1 Sol on DeepSWE 1.110015
OpenAIGPT-6.1 Sol (xhigh)71.9%openai.com for GPT-6.1 Sol (xhigh) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6.1 Sol on DeepSWE 1.110015
OpenAIGPT-6.1 Sol (max)71.9%openai.com for GPT-6.1 Sol (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6.1 Sol on DeepSWE 1.110015
AnthropicClaude Sonnet 5.5 (max)71.0%anthropic.com for Claude Sonnet 5.5 (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on DeepSWE 1.120016
OpenAIGPT-6 Astra (high)73.2%openai.com for GPT-6 Astra (high) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6 Astra on DeepSWE 1.110005
OpenAIGPT-6 Astra (xhigh)74.0%deepswe.datacurve.ai for GPT-6 Astra (xhigh) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for GPT-6 Astra on DeepSWE 1.110005
OpenAIGPT-6 Astra (medium)72.8%openai.com for GPT-6 Astra (medium) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6 Astra on DeepSWE 1.110005
OpenAIGPT-6 Astra (low)67.0%openai.com for GPT-6 Astra (low) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6 Astra on DeepSWE 1.110005
OpenAIGPT-6 Astra (max)73.2%openai.com for GPT-6 Astra (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6 Astra on DeepSWE 1.110005
OpenAIGPT-5.5 (xhigh)67.0%deepswe.datacurve.ai for GPT-5.5 (xhigh) on DeepSWE 1.1 (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for GPT-5.5 on DeepSWE 1.110008
OpenAIGPT-5.6 Luna (medium)9.3%openai.com for GPT-5.6 Luna (medium) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on DeepSWE 1.110009
OpenAIGPT-5.6 Luna (high)42.4%openai.com for GPT-5.6 Luna (high) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on DeepSWE 1.110009
OpenAIGPT-5.6 Luna (max)62.2%openai.com for GPT-5.6 Luna (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on DeepSWE 1.110009
OpenAIGPT-5.6 Luna (low)1.2%openai.com for GPT-5.6 Luna (low) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on DeepSWE 1.110009
OpenAIGPT-5.6 Luna (xhigh)56.2%openai.com for GPT-5.6 Luna (xhigh) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on DeepSWE 1.110009
OpenAIGPT-5.6 Luna (max)67.0%deepswe.datacurve.ai for GPT-5.6 Luna (max) on DeepSWE 1.1 (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for GPT-5.6 Luna on DeepSWE 1.110009
OpenAIGPT-5.6 Sol (xhigh)70.7%openai.com for GPT-5.6 Sol (xhigh) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on DeepSWE 1.110010
OpenAIGPT-5.6 Sol (max)73.0%deepswe.datacurve.ai for GPT-5.6 Sol (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for GPT-5.6 Sol on DeepSWE 1.110010
OpenAIGPT-5.6 Sol (medium)61.1%openai.com for GPT-5.6 Sol (medium) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on DeepSWE 1.110010
OpenAIGPT-5.6 Sol (high)69.4%openai.com for GPT-5.6 Sol (high) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on DeepSWE 1.110010
OpenAIGPT-5.6 Sol (low)45.4%openai.com for GPT-5.6 Sol (low) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on DeepSWE 1.110010
OpenAIGPT-6 Luna (max)66.6%openai.com for GPT-6 Luna (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6 Luna on DeepSWE 1.110013
OpenAIGPT-6 Luna (high)59.3%openai.com for GPT-6 Luna (high) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6 Luna on DeepSWE 1.110013
OpenAIGPT-6 Luna (low)2.4%openai.com for GPT-6 Luna (low) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6 Luna on DeepSWE 1.110013
OpenAIGPT-6 Luna (xhigh)61.3%openai.com for GPT-6 Luna (xhigh) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6 Luna on DeepSWE 1.110013
OpenAIGPT-6 Luna (medium)44.5%openai.com for GPT-6 Luna (medium) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6 Luna on DeepSWE 1.110013
OpenAIGPT-6 Sol (xhigh)66.6%openai.com for GPT-6 Sol (xhigh) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6 Sol on DeepSWE 1.110014
OpenAIGPT-6 Sol (medium)56.6%openai.com for GPT-6 Sol (medium) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6 Sol on DeepSWE 1.110014
OpenAIGPT-6 Sol (max)68.8%openai.com for GPT-6 Sol (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6 Sol on DeepSWE 1.110014
OpenAIGPT-6 Sol (low)37.2%openai.com for GPT-6 Sol (low) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6 Sol on DeepSWE 1.110014
OpenAIGPT-6 Sol (high)65.3%openai.com for GPT-6 Sol (high) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6 Sol on DeepSWE 1.110014
DeepSeek AIDeepSeek-V4-Flash (max)53.0%deepswe.datacurve.ai for DeepSeek-V4-Flash (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for DeepSeek-V4-Flash on DeepSWE 1.1110001
DeepSeek AIDeepSeek-V4-Pro (max)63.0%deepswe.datacurve.ai for DeepSeek-V4-Pro (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for DeepSeek-V4-Pro on DeepSWE 1.1110002
Moonshot AIKimi K3 (max)69.0%deepswe.datacurve.ai for Kimi K3 (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for Kimi K3 on DeepSWE 1.1120003
Alibaba (Tongyi)Qwen3.8-Max (xhigh)57.0%deepswe.datacurve.ai for Qwen3.8-Max (xhigh) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for Qwen3.8-Max on DeepSWE 1.1130008
Z.aiGLM-5.2 (max)44.0%deepswe.datacurve.ai for GLM-5.2 (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for GLM-5.2 on DeepSWE 1.1150004
Z.aiGLM-5.3 (max)69.0%deepswe.datacurve.ai for GLM-5.3 (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for GLM-5.3 on DeepSWE 1.1150005
Z.aiGLM-5.3-Flash (max)63.0%deepswe.datacurve.ai for GLM-5.3-Flash (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for GLM-5.3-Flash on DeepSWE 1.1150006
AnthropicClaude Opus 4.8 (max)59.0%deepswe.datacurve.ai for Claude Opus 4.8 (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for Claude Opus 4.8 on DeepSWE 1.120011
AnthropicClaude Fable 5 (xhigh)70.0%deepswe.datacurve.ai for Claude Fable 5 (xhigh) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for Claude Fable 5 on DeepSWE 1.120012
AnthropicClaude Sonnet 5 (max)54.0%deepswe.datacurve.ai for Claude Sonnet 5 (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for Claude Sonnet 5 on DeepSWE 1.120013
AnthropicClaude Opus 5 (max)74.0%deepswe.datacurve.ai for Claude Opus 5 (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for Claude Opus 5 on DeepSWE 1.120014
AnthropicClaude Opus 5.5 (max)74.2%www-cdn.anthropic.com for Claude Opus 5.5 (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported System cardAnthropicSelf-reportedRecord for Claude Opus 5.5 on DeepSWE 1.120015
Google (DeepMind)Gemini 3.5 Flash (high)36.0%deepswe.datacurve.ai for Gemini 3.5 Flash (high) on DeepSWE 1.1 (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for Gemini 3.5 Flash on DeepSWE 1.130006
Google (DeepMind)Gemini 3.6 Flash (high)47.0%deepswe.datacurve.ai for Gemini 3.6 Flash (high) on DeepSWE 1.1 (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for Gemini 3.6 Flash on DeepSWE 1.130007
Google (DeepMind)Gemini 3.7 Flash (medium)65.0%deepswe.datacurve.ai for Gemini 3.7 Flash (medium) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for Gemini 3.7 Flash on DeepSWE 1.130010
SpaceXAIGrok 4.6 (medium)67.0%deepswe.datacurve.ai for Grok 4.6 (medium) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for Grok 4.6 on DeepSWE 1.140002
SpaceXAIGrok 4.7 (high)71.0%x.ai for Grok 4.7 (high) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postSpaceXAISelf-reportedRecord for Grok 4.7 on DeepSWE 1.140003