MRCR
Updated
Cite
Fill in the access date before citing.
Plain text
Benchmark Registry. MRCR v2 8-needle 256K–512K (o200k_base) benchmark results. Benchmark identifier: mrcr/v2-8-needle-256k-512k-o200k-base. https://benchmarkregistry.org/benchmarks/mrcr/v2-8-needle-256k-512k-o200k-base. Accessed [YYYY-MM-DD]. Data license: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Attribution: Benchmark Registry, a project of Densa Labs — https://benchmarkregistry.org/ (CC BY 4.0). Include the cited record URL and identify any changes.
BibTeX
@misc{br_mrcr_v2_8_needle_256k_512k_o200k_base,
title = {MRCR v2 8-needle 256K–512K (o200k\_base) benchmark results},
publisher = {Benchmark Registry},
url = {https://benchmarkregistry.org/benchmarks/mrcr/v2-8-needle-256k-512k-o200k-base},
urldate = {YYYY-MM-DD},
note = {Benchmark identifier: mrcr/v2-8-needle-256k-512k-o200k-base; data license: CC BY 4.0; access date to be filled by the reader}
}Results
2 results
| Provider | Model | Score | Source | Registry No. |
|---|---|---|---|---|
| Meta AI (originally Facebook AI Research) | Muse Spark 1.2 (xhigh) | 66.3% | dev.meta.ai for Muse Spark 1.2 (xhigh) on MRCR v2 8-needle 256K–512K (o200k_base) (opens in a new tab)Mean sequence-matcher ratioReported Model pageMetaSelf-reportedRecord for Muse Spark 1.2 on MRCR v2 8-needle 256K–512K (o200k_base) | 80003 |
| Meta AI (originally Facebook AI Research) | Muse Spark 1.3 (max) | 98.5% | dev.meta.ai for Muse Spark 1.3 (max) on MRCR v2 8-needle 256K–512K (o200k_base) (opens in a new tab)Mean sequence-matcher ratioReported Model pageMetaSelf-reportedRecord for Muse Spark 1.3 on MRCR v2 8-needle 256K–512K (o200k_base) | 80005 |