Cite

Fill in the access date before citing.

Plain text

Benchmark Registry. MMLU-Pro Original benchmark results. Benchmark identifier: mmlu-pro/original. https://benchmarkregistry.org/benchmarks/mmlu-pro/original. Accessed [YYYY-MM-DD]. Data license: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Attribution: Benchmark Registry, a project of Densa Labs — https://benchmarkregistry.org/ (CC BY 4.0). Include the cited record URL and identify any changes.

BibTeX

@misc{br_mmlu_pro_original,
  title = {MMLU-Pro Original benchmark results},
  publisher = {Benchmark Registry},
  url = {https://benchmarkregistry.org/benchmarks/mmlu-pro/original},
  urldate = {YYYY-MM-DD},
  note = {Benchmark identifier: mmlu-pro/original; data license: CC BY 4.0; access date to be filled by the reader}
}

Report an issue

Benchmark: MMLU-Pro
Evaluated by: Qwen Team
Release date: June 3, 2024
Version: MMLU-Pro Original
Metric: Accuracy

Showing the selected evaluation. Show all results

Score

DeepSeek-V4-Flash (non-thinking)

83.0%

huggingface.coAccuracyReported April 24, 2026DeepSeek AIReport an issue

Cite

Fill in the access date before citing.

Plain text

Benchmark Registry. DeepSeek-V4-Flash: MMLU-Pro Original, 83.0% (non-thinking). Registry No. 110001; Record No. 8b53114bbef0dfc66b2d0d4a3794ca2fcb151558408c3e3bd0ac6f4cc251b007. https://benchmarkregistry.org/benchmarks/mmlu-pro/original?view=history&result=8b53114bbef0dfc66b2d0d4a3794ca2fcb151558408c3e3bd0ac6f4cc251b007#BR-8b53114bbef0dfc66b2d0d4a3794ca2fcb151558408c3e3bd0ac6f4cc251b007. Accessed [YYYY-MM-DD]. Data license: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Attribution: Benchmark Registry, a project of Densa Labs — https://benchmarkregistry.org/ (CC BY 4.0). Include the cited record URL and identify any changes.

BibTeX

@misc{br_8b53114bbef0dfc66b2d0d4a3794ca2fcb151558408c3e3bd0ac6f4cc251b007,
  title = {DeepSeek-V4-Flash: MMLU-Pro Original, 83.0\% (non-thinking)},
  publisher = {Benchmark Registry},
  url = {https://benchmarkregistry.org/benchmarks/mmlu-pro/original?view=history\&result=8b53114bbef0dfc66b2d0d4a3794ca2fcb151558408c3e3bd0ac6f4cc251b007\#BR-8b53114bbef0dfc66b2d0d4a3794ca2fcb151558408c3e3bd0ac6f4cc251b007},
  urldate = {YYYY-MM-DD},
  note = {Registry No. 110001; Record No. 8b53114bbef0dfc66b2d0d4a3794ca2fcb151558408c3e3bd0ac6f4cc251b007; data license: CC BY 4.0; access date to be filled by the reader}
}

Permalink to this record

Badge for this model's latest reported score in the benchmark family; it may differ from this record.

Markdown

![DeepSeek-V4-Flash: MMLU-Pro](https://benchmarkregistry.org/badge/110001/mmlu-pro.svg)

HTML

<img src="https://benchmarkregistry.org/badge/110001/mmlu-pro.svg" alt="DeepSeek-V4-Flash: MMLU-Pro" height="24">

110001

Results