| Anthropic | Claude Opus 4.8 (adaptive thinking, max) | 88.6% | Source for Claude Opus 4.8 (adaptive thinking, max) on SWE-bench Verified (opens in a new tab) | 20011 |
| Anthropic | Claude Opus 4.7 (adaptive thinking, max) | 87.6% | Source for Claude Opus 4.7 (adaptive thinking, max) on SWE-bench Verified (opens in a new tab) | 20010 |
| Anthropic | Claude Sonnet 4.6 (adaptive thinking, max) | 79.6% | Source for Claude Sonnet 4.6 (adaptive thinking, max) on SWE-bench Verified (opens in a new tab) | 20009 |
| Anthropic | Claude Opus 4.6 (adaptive thinking, max) | 80.8% | Source for Claude Opus 4.6 (adaptive thinking, max) on SWE-bench Verified (opens in a new tab) | 20008 |
| Anthropic | Claude Opus 4.5 (no thinking) | 80.9% | Source for Claude Opus 4.5 (no thinking) on SWE-bench Verified (opens in a new tab) | 20007 |
| Anthropic | Claude Haiku 4.5 (extended thinking (128K)) | 73.3% | Source for Claude Haiku 4.5 (extended thinking (128K)) on SWE-bench Verified (opens in a new tab) | 20006 |
| Anthropic | Claude Sonnet 4.5 (extended thinking (200K)) | 77.2% | Source for Claude Sonnet 4.5 (extended thinking (200K)) on SWE-bench Verified (opens in a new tab) | 20005 |
| Anthropic | Claude Opus 4 (standard (no extended thinking)) | 72.5% | Source for Claude Opus 4 (standard (no extended thinking)) on SWE-bench Verified (opens in a new tab) | 20002 |
| Anthropic | Claude Sonnet 4 (standard (no extended thinking)) | 72.7% | Source for Claude Sonnet 4 (standard (no extended thinking)) on SWE-bench Verified (opens in a new tab) | 20003 |
| Anthropic | Claude 3.7 Sonnet (No extended thinking) | 62.3% | Source for Claude 3.7 Sonnet (No extended thinking) on SWE-bench Verified (opens in a new tab) | 20001 |