Versions

2 versions · Metric: Multiple-choice accuracy

Versions of Embodied Reasoning Question Answer
VersionReleasedModelsResults
ERQA No toolsConfiguration: No toolsApril 8, 202611
ERQA With PythonConfiguration: With PythonApril 8, 202611

Recently reported results: ERQA No tools

Most recent configuration: ERQA No tools

Recently reported results for ERQA No tools
ModelScoreSource
Muse Spark (thinking)64.7%ai.meta.com for Muse Spark (thinking) on Embodied Reasoning Question Answer No tools (opens in a new tab)Multiple-choice accuracyReported Evaluation methodologyMetaSelf-reportedRecord for Muse Spark on Embodied Reasoning Question Answer No tools