DeepSWE
DeepSWE results reported for 48 models across 1 version. Updated 2026-10-07.
Report an issueVersions
1 version, plus 3 variants and configurations · Metric: DeepSWE Pass@1
| Version | Released | Models | Results | ||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
DeepSWE 1.1Latest3 variants of 1.1
| June 15, 2026 | 28 | 64 |
Recently reported results: DeepSWE 1.1
Latest version: DeepSWE 1.1
| Model | Score | Source |
|---|---|---|
| GPT-6.1 Sol (high) | 75.2% | openai.com for GPT-6.1 Sol (high) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6.1 Sol on DeepSWE 1.1 |
| GPT-6.1 Sol (low) | 64.4% | openai.com for GPT-6.1 Sol (low) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6.1 Sol on DeepSWE 1.1 |
| GPT-6.1 Sol (medium) | 73.0% | openai.com for GPT-6.1 Sol (medium) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6.1 Sol on DeepSWE 1.1 |
| GPT-6.1 Sol (xhigh) | 71.9% | openai.com for GPT-6.1 Sol (xhigh) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6.1 Sol on DeepSWE 1.1 |
| GPT-6.1 Sol (max) | 71.9% | openai.com for GPT-6.1 Sol (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-6.1 Sol on DeepSWE 1.1 |