Results

35 results

SWE-bench Multilingual results
ProviderModelScoreSourceRegistry No.
AnthropicClaude Haiku 5.5 (max)83.7%anthropic.com for Claude Haiku 5.5 (max) on SWE-bench Multilingual (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Haiku 5.5 on SWE-bench Multilingual20018
AnthropicClaude Sonnet 5.5 (max)90.3%anthropic.com for Claude Sonnet 5.5 (max) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on SWE-bench Multilingual20016
AnthropicClaude Opus 5.5 (max)93.9%www-cdn.anthropic.com for Claude Opus 5.5 (max) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Opus 5.5 on SWE-bench Multilingual20015
AnthropicClaude Fable 5.1 (max)89.1%www-cdn.anthropic.com for Claude Fable 5.1 (max) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Fable 5.1 on SWE-bench Multilingual20004
AnthropicClaude Opus 5 (max)89.5%www-cdn.anthropic.com for Claude Opus 5 (max) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Opus 5 on SWE-bench Multilingual20014
SpaceXAIGrok 4.5 (high)78.0%cursor.com for Grok 4.5 (high) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Model cardSpaceXAI and CursorSelf-reportedCursorRecord for Grok 4.5 on SWE-bench Multilingual40001
AnthropicClaude Sonnet 5 (max)78.3%www-cdn.anthropic.com for Claude Sonnet 5 (max) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5 on SWE-bench Multilingual20013
NVIDIANVIDIA Nemotron 3 Ultra 550B-A55B67.7%huggingface.co for NVIDIA Nemotron 3 Ultra 550B-A55B on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Model cardNVIDIASelf-reportedRecord for NVIDIA Nemotron 3 Ultra 550B-A55B on SWE-bench Multilingual60003
Alibaba (Tongyi)Qwen3.7-Plus75.8%alibabacloud.com for Qwen3.7-Plus on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3.7-Plus on SWE-bench Multilingual130007
AnthropicClaude Opus 4.8 (adaptive thinking, max)84.4%www-cdn.anthropic.com for Claude Opus 4.8 (adaptive thinking, max) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Opus 4.8 on SWE-bench Multilingual20011
Alibaba (Tongyi)Qwen3.7-Max78.3%alibabacloud.com for Qwen3.7-Max on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3.7-Max on SWE-bench Multilingual130006
CursorComposer 2.579.8%cursor.com for Composer 2.5 on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Model pageCursorSelf-reportedRecord for Composer 2.5 on SWE-bench Multilingual50004
DeepSeek AIDeepSeek-V4-Flash (non-thinking)69.7%huggingface.co for DeepSeek-V4-Flash (non-thinking) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Model cardDeepSeekSelf-reportedDeepSeek AIRecord for DeepSeek-V4-Flash on SWE-bench Multilingual110001
DeepSeek AIDeepSeek-V4-Flash (high)70.2%huggingface.co for DeepSeek-V4-Flash (high) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Model cardDeepSeekSelf-reportedDeepSeek AIRecord for DeepSeek-V4-Flash on SWE-bench Multilingual110001
DeepSeek AIDeepSeek-V4-Flash (max)73.3%huggingface.co for DeepSeek-V4-Flash (max) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Model cardDeepSeekSelf-reportedDeepSeek AIRecord for DeepSeek-V4-Flash on SWE-bench Multilingual110001
DeepSeek AIDeepSeek-V4-Pro (max)76.2%huggingface.co for DeepSeek-V4-Pro (max) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Model cardDeepSeekSelf-reportedDeepSeek AIRecord for DeepSeek-V4-Pro on SWE-bench Multilingual110002
DeepSeek AIDeepSeek-V4-Pro (high)74.1%huggingface.co for DeepSeek-V4-Pro (high) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Model cardDeepSeekSelf-reportedDeepSeek AIRecord for DeepSeek-V4-Pro on SWE-bench Multilingual110002
DeepSeek AIDeepSeek-V4-Pro (non-thinking)69.8%huggingface.co for DeepSeek-V4-Pro (non-thinking) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Model cardDeepSeekSelf-reportedDeepSeek AIRecord for DeepSeek-V4-Pro on SWE-bench Multilingual110002
Moonshot AIKimi K2.6 (thinking)76.7%huggingface.co for Kimi K2.6 (thinking) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Model cardMoonshot AISelf-reportedRecord for Kimi K2.6 on SWE-bench Multilingual120002
Alibaba (Tongyi)Qwen3.6-35B-A3B67.2%alibabacloud.com for Qwen3.6-35B-A3B on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3.6-35B-A3B on SWE-bench Multilingual130005
AnthropicClaude Opus 4.7 (adaptive thinking, max)80.5%www-cdn.anthropic.com for Claude Opus 4.7 (adaptive thinking, max) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Opus 4.7 on SWE-bench Multilingual20010
Alibaba (Tongyi)Qwen3.6-Plus73.8%alibabacloud.com for Qwen3.6-Plus on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3.6-Plus on SWE-bench Multilingual130004
CursorComposer 156.9%cursor.com for Composer 1 on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Technical reportCursorSelf-reportedRecord for Composer 1 on SWE-bench Multilingual50001
CursorComposer 1.565.9%cursor.com for Composer 1.5 on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Technical reportCursorSelf-reportedRecord for Composer 1.5 on SWE-bench Multilingual50002
CursorComposer 273.7%cursor.com for Composer 2 on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Technical reportCursorSelf-reportedRecord for Composer 2 on SWE-bench Multilingual50003
MiniMaxMiniMax M2.776.5%minimax.io for MiniMax M2.7 on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Launch postMiniMaxSelf-reportedRecord for MiniMax M2.7 on SWE-bench Multilingual140002
NVIDIANVIDIA Nemotron 3 Super 120B-A12B (OpenHands)45.8%huggingface.co for NVIDIA Nemotron 3 Super 120B-A12B (OpenHands) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Model cardNVIDIASelf-reportedRecord for NVIDIA Nemotron 3 Super 120B-A12B on SWE-bench Multilingual60002
Alibaba (Tongyi)Qwen3.5-397B-A17B69.3%alibabacloud.com for Qwen3.5-397B-A17B on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3.5-397B-A17B on SWE-bench Multilingual130003
AnthropicClaude Sonnet 4.6 (adaptive thinking, max)75.9%www-cdn.anthropic.com for Claude Sonnet 4.6 (adaptive thinking, max) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 4.6 on SWE-bench Multilingual20009
Z.aiGLM-5 (thinking)73.3%z.ai for GLM-5 (thinking) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Launch postZ.aiSelf-reportedRecord for GLM-5 on SWE-bench Multilingual150002
AnthropicClaude Opus 4.6 (adaptive thinking, max)77.8%www-cdn.anthropic.com for Claude Opus 4.6 (adaptive thinking, max) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported System cardAnthropicSelf-reportedRecord for Claude Opus 4.6 on SWE-bench Multilingual20008
Moonshot AIKimi K2.5 (non-thinking)73.0%huggingface.co for Kimi K2.5 (non-thinking) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Model cardMoonshot AISelf-reportedRecord for Kimi K2.5 on SWE-bench Multilingual120001
Z.aiGLM-4.766.7%z.ai for GLM-4.7 on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Launch postZ.aiSelf-reportedRecord for GLM-4.7 on SWE-bench Multilingual150001
Mistral AIDevstral 261.3%huggingface.co for Devstral 2 on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Model cardMistral AISelf-reportedRecord for Devstral 2 on SWE-bench Multilingual90002
Mistral AIDevstral Small 255.7%huggingface.co for Devstral Small 2 on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Model cardMistral AISelf-reportedRecord for Devstral Small 2 on SWE-bench Multilingual90003