Results

51 results

SWE-bench Verified results
ProviderModelScoreSourceRegistry No.
Microsoft AIMAI-Thinking-173.5%microsoft.ai for MAI-Thinking-1 on SWE-bench Verified (opens in a new tab)Resolved TasksReported Technical reportMicrosoft AISelf-reportedMicrosoftRecord for MAI-Thinking-1 on SWE-bench Verified70003
Meta AI (originally Facebook AI Research)Muse Glimmer 30B (high)76.0%dev.meta.ai for Muse Glimmer 30B (high) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model pageMetaSelf-reportedRecord for Muse Glimmer 30B on SWE-bench Verified80004
AnthropicClaude Opus 5 (max)96.0%www-cdn.anthropic.com for Claude Opus 5 (max) on SWE-bench Verified (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Opus 5 on SWE-bench Verified20014
AnthropicClaude Sonnet 5 (max)85.2%www-cdn.anthropic.com for Claude Sonnet 5 (max) on SWE-bench Verified (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5 on SWE-bench Verified20013
AnthropicClaude Fable 595.0%www-cdn.anthropic.com for Claude Fable 5 on SWE-bench Verified (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Fable 5 on SWE-bench Verified20012
NVIDIANVIDIA Nemotron 3 Ultra 550B-A55B70.7%huggingface.co for NVIDIA Nemotron 3 Ultra 550B-A55B on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model cardNVIDIASelf-reportedRecord for NVIDIA Nemotron 3 Ultra 550B-A55B on SWE-bench Verified60003
Alibaba (Tongyi)Qwen3.7-Plus77.7%alibabacloud.com for Qwen3.7-Plus on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3.7-Plus on SWE-bench Verified130007
MiniMaxMiniMax M380.5%huggingface.co for MiniMax M3 on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model cardMiniMaxSelf-reportedRecord for MiniMax M3 on SWE-bench Verified140003
AnthropicClaude Opus 4.8 (adaptive thinking, max)88.6%www-cdn.anthropic.com for Claude Opus 4.8 (adaptive thinking, max) on SWE-bench Verified (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Opus 4.8 on SWE-bench Verified20011
Mistral AIMistral Medium 3.5 (high)77.6%huggingface.co for Mistral Medium 3.5 (high) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model cardMistral AISelf-reportedRecord for Mistral Medium 3.5 on SWE-bench Verified90005
Alibaba (Tongyi)Qwen3.7-Max80.4%alibabacloud.com for Qwen3.7-Max on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3.7-Max on SWE-bench Verified130006
DeepSeek AIDeepSeek-V4-Flash (max)79.0%huggingface.co for DeepSeek-V4-Flash (max) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model cardDeepSeekSelf-reportedDeepSeek AIRecord for DeepSeek-V4-Flash on SWE-bench Verified110001
DeepSeek AIDeepSeek-V4-Flash (high)78.6%huggingface.co for DeepSeek-V4-Flash (high) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model cardDeepSeekSelf-reportedDeepSeek AIRecord for DeepSeek-V4-Flash on SWE-bench Verified110001
DeepSeek AIDeepSeek-V4-Flash (non-thinking)73.7%huggingface.co for DeepSeek-V4-Flash (non-thinking) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model cardDeepSeekSelf-reportedDeepSeek AIRecord for DeepSeek-V4-Flash on SWE-bench Verified110001
DeepSeek AIDeepSeek-V4-Pro (non-thinking)73.6%huggingface.co for DeepSeek-V4-Pro (non-thinking) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model cardDeepSeekSelf-reportedDeepSeek AIRecord for DeepSeek-V4-Pro on SWE-bench Verified110002
DeepSeek AIDeepSeek-V4-Pro (max)80.6%huggingface.co for DeepSeek-V4-Pro (max) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model cardDeepSeekSelf-reportedDeepSeek AIRecord for DeepSeek-V4-Pro on SWE-bench Verified110002
DeepSeek AIDeepSeek-V4-Pro (high)79.4%huggingface.co for DeepSeek-V4-Pro (high) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model cardDeepSeekSelf-reportedDeepSeek AIRecord for DeepSeek-V4-Pro on SWE-bench Verified110002
Moonshot AIKimi K2.6 (thinking)80.2%huggingface.co for Kimi K2.6 (thinking) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model cardMoonshot AISelf-reportedRecord for Kimi K2.6 on SWE-bench Verified120002
Alibaba (Tongyi)Qwen3.6-35B-A3B73.4%alibabacloud.com for Qwen3.6-35B-A3B on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3.6-35B-A3B on SWE-bench Verified130005
AnthropicClaude Opus 4.7 (adaptive thinking, max)87.6%www-cdn.anthropic.com for Claude Opus 4.7 (adaptive thinking, max) on SWE-bench Verified (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Opus 4.7 on SWE-bench Verified20010
Alibaba (Tongyi)Qwen3.6-Plus78.8%alibabacloud.com for Qwen3.6-Plus on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3.6-Plus on SWE-bench Verified130004
NVIDIANVIDIA Nemotron 3 Super 120B-A12B (OpenHands)60.5%huggingface.co for NVIDIA Nemotron 3 Super 120B-A12B (OpenHands) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model cardNVIDIASelf-reportedRecord for NVIDIA Nemotron 3 Super 120B-A12B on SWE-bench Verified60002
Google (DeepMind)Gemini 3.1 Pro (High)80.6%deepmind.google for Gemini 3.1 Pro (High) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model cardGoogle DeepMindSelf-reportedRecord for Gemini 3.1 Pro on SWE-bench Verified30005
Alibaba (Tongyi)Qwen3.5-397B-A17B76.4%alibabacloud.com for Qwen3.5-397B-A17B on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3.5-397B-A17B on SWE-bench Verified130003
AnthropicClaude Sonnet 4.6 (adaptive thinking, max)79.6%www-cdn.anthropic.com for Claude Sonnet 4.6 (adaptive thinking, max) on SWE-bench Verified (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 4.6 on SWE-bench Verified20009
MiniMaxMiniMax M2.580.2%minimax.io for MiniMax M2.5 on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postMiniMaxSelf-reportedRecord for MiniMax M2.5 on SWE-bench Verified140001
Z.aiGLM-5 (thinking)77.8%z.ai for GLM-5 (thinking) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postZ.aiSelf-reportedRecord for GLM-5 on SWE-bench Verified150002
AnthropicClaude Opus 4.6 (adaptive thinking, max)80.8%www-cdn.anthropic.com for Claude Opus 4.6 (adaptive thinking, max) on SWE-bench Verified (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Opus 4.6 on SWE-bench Verified20008
Moonshot AIKimi K2.5 (non-thinking)76.8%huggingface.co for Kimi K2.5 (non-thinking) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model cardMoonshot AISelf-reportedRecord for Kimi K2.5 on SWE-bench Verified120001
Alibaba (Tongyi)Qwen3-Max-Thinking75.3%alibabacloud.com for Qwen3-Max-Thinking on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3-Max-Thinking on SWE-bench Verified130002
Z.aiGLM-4.773.8%z.ai for GLM-4.7 on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postZ.aiSelf-reportedRecord for GLM-4.7 on SWE-bench Verified150001
Google (DeepMind)Gemini 3 Flash78.0%blog.google for Gemini 3 Flash on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postGoogleSelf-reportedGoogle DeepMindRecord for Gemini 3 Flash on SWE-bench Verified30009
OpenAIGPT-5.2 (xhigh)80.0%openai.com for GPT-5.2 (xhigh) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postOpenAISelf-reportedRecord for GPT-5.2 on SWE-bench Verified10012
Mistral AIDevstral 272.2%huggingface.co for Devstral 2 on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model cardMistral AISelf-reportedRecord for Devstral 2 on SWE-bench Verified90002
Mistral AIDevstral Small 268.0%huggingface.co for Devstral Small 2 on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model cardMistral AISelf-reportedRecord for Devstral Small 2 on SWE-bench Verified90003
AnthropicClaude Opus 4.5 (no thinking)80.9%assets.anthropic.com for Claude Opus 4.5 (no thinking) on SWE-bench Verified (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Opus 4.5 on SWE-bench Verified20007
Google (DeepMind)Gemini 3 Pro (high)76.2%blog.google for Gemini 3 Pro (high) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postGoogleSelf-reportedGoogle DeepMindRecord for Gemini 3 Pro on SWE-bench Verified30008
AnthropicClaude Haiku 4.5 (extended thinking (128K))73.3%anthropic.com for Claude Haiku 4.5 (extended thinking (128K)) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postAnthropicSelf-reportedRecord for Claude Haiku 4.5 on SWE-bench Verified20006
AnthropicClaude Sonnet 4.5 (extended thinking (200K))77.2%anthropic.com for Claude Sonnet 4.5 (extended thinking (200K)) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postAnthropicSelf-reportedRecord for Claude Sonnet 4.5 on SWE-bench Verified20005
Alibaba (Tongyi)Qwen3-Max-Instruct69.6%alibabacloud.com for Qwen3-Max-Instruct on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3-Max-Instruct on SWE-bench Verified130001
OpenAIgpt-oss-120b (high)62.4%deploymentsafety.openai.com for gpt-oss-120b (high) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on SWE-bench Verified15001
OpenAIgpt-oss-120b (medium)52.6%deploymentsafety.openai.com for gpt-oss-120b (medium) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on SWE-bench Verified15001
OpenAIgpt-oss-120b (low)47.9%deploymentsafety.openai.com for gpt-oss-120b (low) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on SWE-bench Verified15001
Google (DeepMind)Gemini 2.0 Flash21.4%storage.googleapis.com for Gemini 2.0 Flash on SWE-bench Verified (opens in a new tab)Resolved TasksReported Technical reportGoogleSelf-reportedGoogle DeepMindRecord for Gemini 2.0 Flash on SWE-bench Verified30001
Google (DeepMind)Gemini 2.5 Pro59.6%storage.googleapis.com for Gemini 2.5 Pro on SWE-bench Verified (opens in a new tab)Resolved TasksReported Technical reportGoogleSelf-reportedGoogle DeepMindRecord for Gemini 2.5 Pro on SWE-bench Verified30002
Google (DeepMind)Gemini 2.5 Flash48.9%storage.googleapis.com for Gemini 2.5 Flash on SWE-bench Verified (opens in a new tab)Resolved TasksReported Technical reportGoogleSelf-reportedGoogle DeepMindRecord for Gemini 2.5 Flash on SWE-bench Verified30003
AnthropicClaude Opus 4 (standard (no extended thinking))72.5%anthropic.com for Claude Opus 4 (standard (no extended thinking)) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postAnthropicSelf-reportedRecord for Claude Opus 4 on SWE-bench Verified20002
AnthropicClaude Sonnet 4 (standard (no extended thinking))72.7%anthropic.com for Claude Sonnet 4 (standard (no extended thinking)) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postAnthropicSelf-reportedRecord for Claude Sonnet 4 on SWE-bench Verified20003
OpenAIGPT-4.5 Preview38.0%openai.com for GPT-4.5 Preview on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postOpenAISelf-reportedRecord for GPT-4.5 Preview on SWE-bench Verified10001
OpenAIGPT-4.154.6%openai.com for GPT-4.1 on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postOpenAISelf-reportedRecord for GPT-4.1 on SWE-bench Verified10002