HLE-Verified
Updated
Cite
Fill in the access date before citing.
Plain text
Benchmark Registry. HLE-Verified Full 1,811-item verified set benchmark results. Benchmark identifier: hle-verified/full-1811-item-set. https://benchmarkregistry.org/benchmarks/hle-verified/full-1811-item-set. Accessed [YYYY-MM-DD]. Data license: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Attribution: Benchmark Registry, a project of Densa Labs — https://benchmarkregistry.org/ (CC BY 4.0). Include the cited record URL and identify any changes.
BibTeX
@misc{br_hle_verified_full_1811_item_set,
title = {HLE-Verified Full 1,811-item verified set benchmark results},
publisher = {Benchmark Registry},
url = {https://benchmarkregistry.org/benchmarks/hle-verified/full-1811-item-set},
urldate = {YYYY-MM-DD},
note = {Benchmark identifier: hle-verified/full-1811-item-set; data license: CC BY 4.0; access date to be filled by the reader}
}Results
2 results
| Provider | Model | Score | Source | Registry No. |
|---|---|---|---|---|
| Google (DeepMind) | Gemini 3.8 Flash | 54.9% | deepmind.google for Gemini 3.8 Flash on HLE-Verified Full 1,811-item verified set (opens in a new tab)HLE-Verified AccuracyReported Model cardGoogle DeepMindSelf-reportedRecord for Gemini 3.8 Flash on HLE-Verified Full 1,811-item verified set | 30004 |
| Google (DeepMind) | Gemini 3.7 Flash | 53.6% | deepmind.google for Gemini 3.7 Flash on HLE-Verified Full 1,811-item verified set (opens in a new tab)HLE-Verified AccuracyReported Model cardGoogle DeepMindSelf-reportedRecord for Gemini 3.7 Flash on HLE-Verified Full 1,811-item verified set | 30010 |