MMLU-Pro
Updated
Cite
Fill in the access date before citing.
Plain text
Benchmark Registry. MMLU-Pro Original benchmark results. Benchmark identifier: mmlu-pro/original. https://benchmarkregistry.org/benchmarks/mmlu-pro/original. Accessed [YYYY-MM-DD]. Data license: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Attribution: Benchmark Registry, a project of Densa Labs — https://benchmarkregistry.org/ (CC BY 4.0). Include the cited record URL and identify any changes.
BibTeX
@misc{br_mmlu_pro_original,
title = {MMLU-Pro Original benchmark results},
publisher = {Benchmark Registry},
url = {https://benchmarkregistry.org/benchmarks/mmlu-pro/original},
urldate = {YYYY-MM-DD},
note = {Benchmark identifier: mmlu-pro/original; data license: CC BY 4.0; access date to be filled by the reader}
}Showing the selected evaluation. Show all results
Results
1 result
| Provider | Model | Score | Source | Registry No. |
|---|---|---|---|---|
| DeepSeek AI | DeepSeek-V4-Pro (max) | 87.5% | huggingface.co for DeepSeek-V4-Pro (max) on MMLU-Pro Original (opens in a new tab)AccuracyReported DeepSeek AIReport an issueCiteFill in the access date before citing. Plain text Benchmark Registry. DeepSeek-V4-Pro: MMLU-Pro Original, 87.5% (max). Registry No. 110002; Record No. 59359c08349b3251f218317bd7d235461241737d48f1831faff07da8cf51bea4. https://benchmarkregistry.org/benchmarks/mmlu-pro/original?view=history&result=59359c08349b3251f218317bd7d235461241737d48f1831faff07da8cf51bea4#BR-59359c08349b3251f218317bd7d235461241737d48f1831faff07da8cf51bea4. Accessed [YYYY-MM-DD]. Data license: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Attribution: Benchmark Registry, a project of Densa Labs — https://benchmarkregistry.org/ (CC BY 4.0). Include the cited record URL and identify any changes. BibTeX @misc{br_59359c08349b3251f218317bd7d235461241737d48f1831faff07da8cf51bea4,
title = {DeepSeek-V4-Pro: MMLU-Pro Original, 87.5\% (max)},
publisher = {Benchmark Registry},
url = {https://benchmarkregistry.org/benchmarks/mmlu-pro/original?view=history\&result=59359c08349b3251f218317bd7d235461241737d48f1831faff07da8cf51bea4\#BR-59359c08349b3251f218317bd7d235461241737d48f1831faff07da8cf51bea4},
urldate = {YYYY-MM-DD},
note = {Registry No. 110002; Record No. 59359c08349b3251f218317bd7d235461241737d48f1831faff07da8cf51bea4; data license: CC BY 4.0; access date to be filled by the reader}
}Badge for this model's latest reported score in the benchmark family; it may differ from this record. Markdown  HTML <img src="https://benchmarkregistry.org/badge/110002/mmlu-pro.svg" alt="DeepSeek-V4-Pro: MMLU-Pro" height="24"> | 110002 |