Results

25 results

SWE-bench Multilingual results
ProviderModelScoreSourceRegistry No.
AnthropicClaude Sonnet 5.5 (max)90.3%Source for Claude Sonnet 5.5 (max) on SWE-bench Multilingual (opens in a new tab)20016
NVIDIANVIDIA Nemotron 3 Ultra 550B-A55B67.7%Source for NVIDIA Nemotron 3 Ultra 550B-A55B on SWE-bench Multilingual (opens in a new tab)60003
Alibaba (Tongyi)Qwen3.7-Plus75.8%Source for Qwen3.7-Plus on SWE-bench Multilingual (opens in a new tab)130007
AnthropicClaude Opus 4.8 (adaptive thinking, max)84.4%Source for Claude Opus 4.8 (adaptive thinking, max) on SWE-bench Multilingual (opens in a new tab)20011
Alibaba (Tongyi)Qwen3.7-Max78.3%Source for Qwen3.7-Max on SWE-bench Multilingual (opens in a new tab)130006
CursorComposer 2.579.8%Source for Composer 2.5 on SWE-bench Multilingual (opens in a new tab)50004
DeepSeek AIDeepSeek-V4-Flash (max)73.3%Source for DeepSeek-V4-Flash (max) on SWE-bench Multilingual (opens in a new tab)110001
DeepSeek AIDeepSeek-V4-Pro (max)76.2%Source for DeepSeek-V4-Pro (max) on SWE-bench Multilingual (opens in a new tab)110002
Moonshot AIKimi K2.6 (thinking)76.7%Source for Kimi K2.6 (thinking) on SWE-bench Multilingual (opens in a new tab)120002
Alibaba (Tongyi)Qwen3.6-35B-A3B67.2%Source for Qwen3.6-35B-A3B on SWE-bench Multilingual (opens in a new tab)130005
AnthropicClaude Opus 4.7 (adaptive thinking, max)80.5%Source for Claude Opus 4.7 (adaptive thinking, max) on SWE-bench Multilingual (opens in a new tab)20010
Alibaba (Tongyi)Qwen3.6-Plus73.8%Source for Qwen3.6-Plus on SWE-bench Multilingual (opens in a new tab)130004
CursorComposer 156.9%Source for Composer 1 on SWE-bench Multilingual (opens in a new tab)50001
CursorComposer 1.565.9%Source for Composer 1.5 on SWE-bench Multilingual (opens in a new tab)50002
CursorComposer 273.7%Source for Composer 2 on SWE-bench Multilingual (opens in a new tab)50003
MiniMaxMiniMax M2.776.5%Source for MiniMax M2.7 on SWE-bench Multilingual (opens in a new tab)140002
NVIDIANVIDIA Nemotron 3 Super 120B-A12B (OpenHands)45.8%Source for NVIDIA Nemotron 3 Super 120B-A12B (OpenHands) on SWE-bench Multilingual (opens in a new tab)60002
Alibaba (Tongyi)Qwen3.5-397B-A17B69.3%Source for Qwen3.5-397B-A17B on SWE-bench Multilingual (opens in a new tab)130003
AnthropicClaude Sonnet 4.6 (adaptive thinking, max)75.9%Source for Claude Sonnet 4.6 (adaptive thinking, max) on SWE-bench Multilingual (opens in a new tab)20009
Z.aiGLM-5 (thinking)73.3%Source for GLM-5 (thinking) on SWE-bench Multilingual (opens in a new tab)150002
AnthropicClaude Opus 4.6 (adaptive thinking, max)77.8%Source for Claude Opus 4.6 (adaptive thinking, max) on SWE-bench Multilingual (opens in a new tab)20008
Moonshot AIKimi K2.5 (non-thinking)73.0%Source for Kimi K2.5 (non-thinking) on SWE-bench Multilingual (opens in a new tab)120001
Z.aiGLM-4.766.7%Source for GLM-4.7 on SWE-bench Multilingual (opens in a new tab)150001
Mistral AIDevstral 261.3%Source for Devstral 2 on SWE-bench Multilingual (opens in a new tab)90002
Mistral AIDevstral Small 255.7%Source for Devstral Small 2 on SWE-bench Multilingual (opens in a new tab)90003