ERQA
Embodied Reasoning Question Answer
Updated
Cite
Fill in the access date before citing.
Plain text
Benchmark Registry. Embodied Reasoning Question Answer With Python benchmark results. Benchmark identifier: erqa/with-python. https://benchmarkregistry.org/benchmarks/erqa/with-python. Accessed [YYYY-MM-DD]. Data license: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Attribution: Benchmark Registry, a project of Densa Labs — https://benchmarkregistry.org/ (CC BY 4.0). Include the cited record URL and identify any changes.
BibTeX
@misc{br_erqa_with_python,
title = {Embodied Reasoning Question Answer With Python benchmark results},
publisher = {Benchmark Registry},
url = {https://benchmarkregistry.org/benchmarks/erqa/with-python},
urldate = {YYYY-MM-DD},
note = {Benchmark identifier: erqa/with-python; data license: CC BY 4.0; access date to be filled by the reader}
}Results
1 result
| Provider | Model | Score | Source | Registry No. |
|---|---|---|---|---|
| Meta AI (originally Facebook AI Research) | Muse Spark (thinking) | 67.0% | ai.meta.com for Muse Spark (thinking) on Embodied Reasoning Question Answer With Python (opens in a new tab)Multiple-choice accuracyReported Evaluation methodologyMetaSelf-reportedRecord for Muse Spark on Embodied Reasoning Question Answer With Python | 80001 |