Skip to main content
Benchmark Registry
Models
Benchmarks
Organizations
Search the registry
Search
SWE-bench
Benchmark
SWE-bench
Evaluated by
OpenAI, Princeton University
Release date
August 13, 2024
Version
SWE-bench Verified
Metric
Resolved Tasks
Search models
Search
Results
2 results
Rows per page
50
100
500
Apply
Latest
History
All providers
Alibaba (Tongyi)
Anthropic
DeepSeek AI
Google (DeepMind)
Meta AI (originally Facebook AI Research)
Microsoft AI
MiniMax
Mistral AI
Moonshot AI
NVIDIA
OpenAI
Z.ai
SWE-bench Verified results
Provider
Model
Score
Source
Registry No.
NVIDIA
NVIDIA Nemotron 3 Ultra 550B-A55B
70.7%
Source
for NVIDIA Nemotron 3 Ultra 550B-A55B on SWE-bench Verified
(opens in a new tab)
60003
NVIDIA
NVIDIA Nemotron 3 Super 120B-A12B
(OpenHands)
60.5%
Source
for NVIDIA Nemotron 3 Super 120B-A12B (OpenHands) on SWE-bench Verified
(opens in a new tab)
60002
Previous
Page
1
of
1
Next