Benchmarks

10 results across 10 benchmarks

Benchmark results for Muse Glimmer 30B
BenchmarkScoreSource
Chartography October 2026 leaderboardEffort: xHigh17.2%surgehq.ai for Muse Glimmer 30B (xHigh) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Muse Glimmer 30B on Chartography October 2026 leaderboard
CharXiv Reasoning — No toolsEffort: HighConfiguration: No tools78.8%dev.meta.ai for Muse Glimmer 30B (high) on CharXiv Reasoning — No tools (opens in a new tab)CharXiv AccuracyReported Model pageMetaSelf-reportedRecord for Muse Glimmer 30B on CharXiv Reasoning — No tools
DeepSearchQA 900-prompt setEffort: High74.6%dev.meta.ai for Muse Glimmer 30B (high) on DeepSearchQA 900-prompt set (opens in a new tab)F1 scoreReported Model pageMetaSelf-reportedRecord for Muse Glimmer 30B on DeepSearchQA 900-prompt set
GAIA2 Public 800 tasksEffort: High43.3%dev.meta.ai for Muse Glimmer 30B (high) on GAIA2 Public 800 tasks (opens in a new tab)Task success rateReported Model pageMetaSelf-reportedRecord for Muse Glimmer 30B on GAIA2 Public 800 tasks
IFBench OriginalEffort: High77.0%dev.meta.ai for Muse Glimmer 30B (high) on IFBench Original (opens in a new tab)AccuracyReported Model pageMetaSelf-reportedRecord for Muse Glimmer 30B on IFBench Original
OSWorld VerifiedEffort: High65.9%dev.meta.ai for Muse Glimmer 30B (high) on OSWorld Verified (opens in a new tab)OSWorld-Verified success rateReported Model pageMetaSelf-reportedRecord for Muse Glimmer 30B on OSWorld Verified
Riemann-bench October 2026 leaderboardEffort: xHigh13.6%surgehq.ai for Muse Glimmer 30B (xHigh) on Riemann-bench October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Riemann-bench Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Muse Glimmer 30B on Riemann-bench October 2026 leaderboard
SkillsBench 86-task set — With skillsEffort: HighConfiguration: With skills44.3%dev.meta.ai for Muse Glimmer 30B (high) on SkillsBench 86-task set — With skills (opens in a new tab)Task success rateReported Model pageMetaSelf-reportedRecord for Muse Glimmer 30B on SkillsBench 86-task set — With skills
SWE-bench VerifiedEffort: High76.0%dev.meta.ai for Muse Glimmer 30B (high) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model pageMetaSelf-reportedRecord for Muse Glimmer 30B on SWE-bench Verified
SWE-bench Pro PublicEffort: High51.2%dev.meta.ai for Muse Glimmer 30B (high) on SWE-bench Pro Public (opens in a new tab)Public tasks resolvedReported Model pageMetaSelf-reportedRecord for Muse Glimmer 30B on SWE-bench Pro Public