OpenAI GPT-4.1 48.5% epoch.ai for GPT-4.1 on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated February 8, 2026 at 5:41 PM UTC Benchmark leaderboard Epoch AI Independent Record for GPT-4.1 on SWE-bench Verified — Epoch AI harness 10002 OpenAI OpenAI o3 (medium)62.3% epoch.ai for OpenAI o3 (medium) on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated February 12, 2026 at 3:46 AM UTC Benchmark leaderboard Epoch AI Independent Record for OpenAI o3 on SWE-bench Verified — Epoch AI harness 10003 OpenAI GPT-5.3-Codex (high)74.8% epoch.ai for GPT-5.3-Codex (high) on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated February 25, 2026 at 10:37 AM UTC Benchmark leaderboard Epoch AI Independent Record for GPT-5.3-Codex on SWE-bench Verified — Epoch AI harness 10006 OpenAI GPT-5.4 (high)76.9% epoch.ai for GPT-5.4 (high) on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated March 6, 2026 at 11:07 AM UTC Benchmark leaderboard Epoch AI Independent Record for GPT-5.4 on SWE-bench Verified — Epoch AI harness 10007 OpenAI GPT-5.2 (high)73.8% epoch.ai for GPT-5.2 (high) on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated February 12, 2026 at 1:34 PM UTC Benchmark leaderboard Epoch AI Independent Record for GPT-5.2 on SWE-bench Verified — Epoch AI harness 10012 OpenAI GPT-5 (medium)71.5% epoch.ai for GPT-5 (medium) on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated February 5, 2026 at 1:39 PM UTC Benchmark leaderboard Epoch AI Independent Record for GPT-5 on SWE-bench Verified — Epoch AI harness 10018 OpenAI GPT-5 (high)73.6% epoch.ai for GPT-5 (high) on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated February 6, 2026 at 2:23 PM UTC Benchmark leaderboard Epoch AI Independent Record for GPT-5 on SWE-bench Verified — Epoch AI harness 10018 OpenAI GPT-5 mini (medium)64.7% epoch.ai for GPT-5 mini (medium) on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated February 1, 2026 at 11:28 AM UTC Benchmark leaderboard Epoch AI Independent Record for GPT-5 mini on SWE-bench Verified — Epoch AI harness 10019 DeepSeek AI DeepSeek-V4-Pro (max)77.6% epoch.ai for DeepSeek-V4-Pro (max) on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated June 18, 2026 at 5:43 PM UTC Benchmark leaderboard Epoch AI Independent Record for DeepSeek-V4-Pro on SWE-bench Verified — Epoch AI harness 110002 Moonshot AI Kimi K2.5 73.8% epoch.ai for Kimi K2.5 on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated February 17, 2026 at 2:43 PM UTC Benchmark leaderboard Epoch AI Independent Record for Kimi K2.5 on SWE-bench Verified — Epoch AI harness 120001 Moonshot AI Kimi K2.6 76.7% epoch.ai for Kimi K2.6 on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated May 8, 2026 at 10:21 AM UTC Benchmark leaderboard Epoch AI Independent Record for Kimi K2.6 on SWE-bench Verified — Epoch AI harness 120002 Alibaba (Tongyi) Qwen3.6-Plus 57.9% epoch.ai for Qwen3.6-Plus on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated May 14, 2026 at 5:28 PM UTC Benchmark leaderboard Epoch AI Independent Record for Qwen3.6-Plus on SWE-bench Verified — Epoch AI harness 130004 Alibaba (Tongyi) Qwen3.7-Max 77.3% epoch.ai for Qwen3.7-Max on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated June 18, 2026 at 5:48 PM UTC Benchmark leaderboard Epoch AI Independent Record for Qwen3.7-Max on SWE-bench Verified — Epoch AI harness 130006 Z.ai GLM-5 72.1% epoch.ai for GLM-5 on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated February 15, 2026 at 3:40 PM UTC Benchmark leaderboard Epoch AI Independent Record for GLM-5 on SWE-bench Verified — Epoch AI harness 150002 Z.ai GLM-5.1 74.2% epoch.ai for GLM-5.1 on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated May 15, 2026 at 10:07 AM UTC Benchmark leaderboard Epoch AI Independent Record for GLM-5.1 on SWE-bench Verified — Epoch AI harness 150003 Z.ai GLM-5.2 (max)78.7% epoch.ai for GLM-5.2 (max) on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated June 25, 2026 at 1:13 PM UTC Benchmark leaderboard Epoch AI Independent Record for GLM-5.2 on SWE-bench Verified — Epoch AI harness 150004 Anthropic Claude 3.7 Sonnet 61.0% epoch.ai for Claude 3.7 Sonnet on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated February 4, 2026 at 6:05 PM UTC Benchmark leaderboard Epoch AI Independent Record for Claude 3.7 Sonnet on SWE-bench Verified — Epoch AI harness 20001 Anthropic Claude Opus 4 70.7% epoch.ai for Claude Opus 4 on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated February 6, 2026 at 7:21 AM UTC Benchmark leaderboard Epoch AI Independent Record for Claude Opus 4 on SWE-bench Verified — Epoch AI harness 20002 Anthropic Claude Sonnet 4.5 71.3% epoch.ai for Claude Sonnet 4.5 on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated February 5, 2026 at 4:52 PM UTC Benchmark leaderboard Epoch AI Independent Record for Claude Sonnet 4.5 on SWE-bench Verified — Epoch AI harness 20005 Anthropic Claude Opus 4.5 76.7% epoch.ai for Claude Opus 4.5 on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated February 5, 2026 at 10:06 PM UTC Benchmark leaderboard Epoch AI Independent Record for Claude Opus 4.5 on SWE-bench Verified — Epoch AI harness 20007 Anthropic Claude Opus 4.6 75.6% epoch.ai for Claude Opus 4.6 on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated February 10, 2026 at 10:23 PM UTC Benchmark leaderboard Epoch AI Independent Record for Claude Opus 4.6 on SWE-bench Verified — Epoch AI harness 20008 Anthropic Claude Sonnet 4.6 75.2% epoch.ai for Claude Sonnet 4.6 on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated February 21, 2026 at 10:32 AM UTC Benchmark leaderboard Epoch AI Independent Record for Claude Sonnet 4.6 on SWE-bench Verified — Epoch AI harness 20009 Anthropic Claude Opus 4.7 (max)83.5% epoch.ai for Claude Opus 4.7 (max) on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated April 20, 2026 at 1:16 PM UTC Benchmark leaderboard Epoch AI Independent Record for Claude Opus 4.7 on SWE-bench Verified — Epoch AI harness 20010 Anthropic Claude Opus 4.1 73.3% epoch.ai for Claude Opus 4.1 on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated February 11, 2026 at 9:33 PM UTC Benchmark leaderboard Epoch AI Independent Record for Claude Opus 4.1 on SWE-bench Verified — Epoch AI harness 20017 Google (DeepMind) Gemini 3.5 Flash (high)79.3% epoch.ai for Gemini 3.5 Flash (high) on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated June 1, 2026 at 10:22 AM UTC Benchmark leaderboard Epoch AI Independent Record for Gemini 3.5 Flash on SWE-bench Verified — Epoch AI harness 30006 Google (DeepMind) Gemini 3 Pro 72.9% epoch.ai for Gemini 3 Pro on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated February 13, 2026 at 10:43 AM UTC Benchmark leaderboard Epoch AI Independent Record for Gemini 3 Pro on SWE-bench Verified — Epoch AI harness 30008 Google (DeepMind) Gemini 3 Flash 75.4% epoch.ai for Gemini 3 Flash on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated February 18, 2026 at 8:12 PM UTC Benchmark leaderboard Epoch AI Independent Record for Gemini 3 Flash on SWE-bench Verified — Epoch AI harness 30009