Cite

Fill in the access date before citing.

Plain text

Benchmark Registry. SWE-bench Verified benchmark results. Benchmark identifier: swe-bench/verified. https://benchmarkregistry.org/benchmarks/swe-bench/verified. Accessed [YYYY-MM-DD]. Data license: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Attribution: Benchmark Registry, a project of Densa Labs — https://benchmarkregistry.org/ (CC BY 4.0). Include the cited record URL and identify any changes.

BibTeX

@misc{br_swe_bench_verified,
  title = {SWE-bench Verified benchmark results},
  publisher = {Benchmark Registry},
  url = {https://benchmarkregistry.org/benchmarks/swe-bench/verified},
  urldate = {YYYY-MM-DD},
  note = {Benchmark identifier: swe-bench/verified; data license: CC BY 4.0; access date to be filled by the reader}
}

Report an issue

Benchmark: SWE-bench
Evaluated by: OpenAI, Princeton University
Release date: August 13, 2024
Version: SWE-bench Verified
Metric: Resolved Tasks

Showing the selected evaluation. Show all results

Score

DeepSeek-V4-Pro (non-thinking)

73.6%

huggingface.coResolved TasksReported April 24, 2026DeepSeek AIReport an issue

Cite

Fill in the access date before citing.

Plain text

Benchmark Registry. DeepSeek-V4-Pro: SWE-bench Verified, 73.6% (non-thinking). Registry No. 110002; Record No. 030bdda19326916c462bac5fe67420fd6efb47e27daffc89505c56bb81f07514. https://benchmarkregistry.org/benchmarks/swe-bench/verified?view=history&result=030bdda19326916c462bac5fe67420fd6efb47e27daffc89505c56bb81f07514#BR-030bdda19326916c462bac5fe67420fd6efb47e27daffc89505c56bb81f07514. Accessed [YYYY-MM-DD]. Data license: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Attribution: Benchmark Registry, a project of Densa Labs — https://benchmarkregistry.org/ (CC BY 4.0). Include the cited record URL and identify any changes.

BibTeX

@misc{br_030bdda19326916c462bac5fe67420fd6efb47e27daffc89505c56bb81f07514,
  title = {DeepSeek-V4-Pro: SWE-bench Verified, 73.6\% (non-thinking)},
  publisher = {Benchmark Registry},
  url = {https://benchmarkregistry.org/benchmarks/swe-bench/verified?view=history\&result=030bdda19326916c462bac5fe67420fd6efb47e27daffc89505c56bb81f07514\#BR-030bdda19326916c462bac5fe67420fd6efb47e27daffc89505c56bb81f07514},
  urldate = {YYYY-MM-DD},
  note = {Registry No. 110002; Record No. 030bdda19326916c462bac5fe67420fd6efb47e27daffc89505c56bb81f07514; data license: CC BY 4.0; access date to be filled by the reader}
}

Permalink to this record

Badge for this model's latest reported score in the benchmark family; it may differ from this record.

Markdown

![DeepSeek-V4-Pro: SWE-bench](https://benchmarkregistry.org/badge/110002/swe-bench.svg)

HTML

<img src="https://benchmarkregistry.org/badge/110002/swe-bench.svg" alt="DeepSeek-V4-Pro: SWE-bench" height="24">

110002

Results