APEX-Agents Original Effort: xHigh 31.8% mercor.com for Muse Spark 1.1 (xhigh) on APEX-Agents Original (opens in a new tab) Archived copy (opens in a new tab) Pass rate Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Muse Spark 1.1 on APEX-Agents Original BabyVision Original Effort: xHigh 76.3% dev.meta.ai for Muse Spark 1.1 (xhigh) on BabyVision Original (opens in a new tab) Accuracy Reported July 9, 2026 Model page Meta Self-reported Record for Muse Spark 1.1 on BabyVision Original Chartography October 2026 leaderboard Effort: xHigh 24.4% surgehq.ai for Muse Spark 1.1 (xHigh) on Chartography October 2026 leaderboard (opens in a new tab) Archived copy (opens in a new tab) Chartography Pass@1 Reported October 7, 2026 Benchmark leaderboard Surge AI Independent Record for Muse Spark 1.1 on Chartography October 2026 leaderboard CharXiv Descriptive and reasoning — Mercor single-shot Effort: xHigh Configuration: Mercor single-shot agent 95.2% mercor.com for Muse Spark 1.1 (xhigh) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab) Archived copy (opens in a new tab) CharXiv Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Muse Spark 1.1 on CharXiv Descriptive and reasoning — Mercor single-shot CharXiv Reasoning — No tools Effort: xHigh Configuration: No tools 88.4% dev.meta.ai for Muse Spark 1.1 (xhigh) on CharXiv Reasoning — No tools (opens in a new tab) CharXiv Accuracy Reported July 9, 2026 Model page Meta Self-reported Record for Muse Spark 1.1 on CharXiv Reasoning — No tools CyberGym Original Effort: High 59.0% ai.meta.com for Muse Spark 1.1 (high) on CyberGym Original (opens in a new tab) Vulnerability reproduction success Reported July 9, 2026 Evaluation report Meta Self-reported Record for Muse Spark 1.1 on CyberGym Original DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps Effort: xHigh Configuration: Mercor mini-swe-agent, 500 steps, 2 hours 40.4% mercor.com for Muse Spark 1.1 (xhigh) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Muse Spark 1.1 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps DeepSWE 1.1 — mini-swe-agent Effort: xHigh Configuration: mini-swe-agent harness 53.3% dev.meta.ai for Muse Spark 1.1 (xhigh) on DeepSWE 1.1 — mini-swe-agent (opens in a new tab) DeepSWE Pass@1 Reported July 9, 2026 Model page Meta Self-reported Record for Muse Spark 1.1 on DeepSWE 1.1 — mini-swe-agent Finance Agent Benchmark 2 — October 2026 evaluation Effort: xHigh 57.2% vals.ai for Muse Spark 1.1 (xhigh) on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab) Archived copy (opens in a new tab) Finance Agent Accuracy Reported October 6, 2026 Benchmark leaderboard Vals AI Independent Record for Muse Spark 1.1 on Finance Agent Benchmark 2 — October 2026 evaluation GPQA Diamond — Mercor single-shot Effort: xHigh Configuration: Mercor single-shot agent 90.8% mercor.com for Muse Spark 1.1 (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab) Archived copy (opens in a new tab) GPQA Diamond Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Muse Spark 1.1 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot GPQA Diamond — Vals AI harness Effort: xHigh Configuration: Vals AI harness: mean of zero-shot and few-shot CoT 91.2% vals.ai for Muse Spark 1.1 (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab) Archived copy (opens in a new tab) GPQA Diamond Accuracy Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Muse Spark 1.1 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness HLAB October 2026 evaluation Effort: xHigh 20.0% vals.ai for Muse Spark 1.1 (xhigh) on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab) Archived copy (opens in a new tab) HLAB Task Pass Rate Reported October 6, 2026 Benchmark leaderboard Vals AI Independent Record for Muse Spark 1.1 on Harvey's Legal Agent Benchmark October 2026 evaluation Humanity's Last Exam Full set — With tools Effort: xHigh Configuration: With tools 62.1% dev.meta.ai for Muse Spark 1.1 (xhigh) on Humanity's Last Exam Full set — With tools (opens in a new tab) Humanity's Last Exam Accuracy Reported July 9, 2026 Model page Meta Self-reported Record for Muse Spark 1.1 on Humanity's Last Exam Full set — With tools JobBench Main 65 tasks Effort: xHigh 54.7% dev.meta.ai for Muse Spark 1.1 (xhigh) on JobBench Main 65 tasks (opens in a new tab) Mean rubric score Reported July 9, 2026 Model page Meta Self-reported Record for Muse Spark 1.1 on JobBench Main 65 tasks MCP Atlas Public, April 2026 update 88.1% labs.scale.com for Muse Spark 1.1 on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for Muse Spark 1.1 on MCP Atlas Public, April 2026 update MedXpertQA MM — Mercor single-shot Effort: xHigh Configuration: Mercor single-shot agent 77.0% mercor.com for Muse Spark 1.1 (xhigh) on MedXpertQA MM — Mercor single-shot (opens in a new tab) Archived copy (opens in a new tab) Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Muse Spark 1.1 on MedXpertQA MM — Mercor single-shot MMLU-Pro Original — Mercor single-shot Effort: xHigh Configuration: Mercor single-shot agent 89.9% mercor.com for Muse Spark 1.1 (xhigh) on MMLU-Pro Original — Mercor single-shot (opens in a new tab) Archived copy (opens in a new tab) Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Muse Spark 1.1 on MMLU-Pro Original — Mercor single-shot MMLU-Pro Original — Vals AI harness Effort: xHigh Configuration: Vals AI harness 88.7% vals.ai for Muse Spark 1.1 (xhigh) on MMLU-Pro Original — Vals AI harness (opens in a new tab) Archived copy (opens in a new tab) Accuracy Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Muse Spark 1.1 on MMLU-Pro Original — Vals AI harness MMMU-Pro 1,730 questions — Mercor single-shot Effort: xHigh Configuration: Mercor single-shot agent 81.3% mercor.com for Muse Spark 1.1 (xhigh) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab) Archived copy (opens in a new tab) MMMU-Pro accuracy Setting: Not stated Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Muse Spark 1.1 on MMMU-Pro 1,730 questions — Mercor single-shot MMMU-Pro Vals AI harness Effort: xHigh Configuration: Vals AI harness 86.6% vals.ai for Muse Spark 1.1 (xhigh) on MMMU-Pro Vals AI harness (opens in a new tab) Archived copy (opens in a new tab) MMMU-Pro accuracy Setting: Standard (4 options) Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Muse Spark 1.1 on MMMU-Pro Vals AI harness OSWorld Verified Effort: xHigh 80.8% dev.meta.ai for Muse Spark 1.1 (xhigh) on OSWorld Verified (opens in a new tab) OSWorld-Verified success rate Reported July 9, 2026 Model page Meta Self-reported Record for Muse Spark 1.1 on OSWorld Verified OSWorld Verified — 100 steps Configuration: 100-step limit 80.7% os-world.github.io for Muse Spark 1.1 on OSWorld Verified — 100 steps (opens in a new tab) Archived copy (opens in a new tab) OSWorld-Verified success rate Reported July 9, 2026 Benchmark leaderboard OSWorld Independent XLang Lab Record for Muse Spark 1.1 on OSWorld Verified — 100 steps Riemann-bench October 2026 leaderboard Effort: xHigh 20.8% surgehq.ai for Muse Spark 1.1 (xHigh) on Riemann-bench October 2026 leaderboard (opens in a new tab) Archived copy (opens in a new tab) Riemann-bench Pass@1 Reported October 7, 2026 Benchmark leaderboard Surge AI Independent Record for Muse Spark 1.1 on Riemann-bench October 2026 leaderboard SimpleQA Verified Original — Epoch AI harness Configuration: Epoch AI harness 57.8% epoch.ai for Muse Spark 1.1 on SimpleQA Verified Original — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Accuracy Reported October 7, 2026 Evaluated August 31, 2026 at 7:21 PM UTC Benchmark leaderboard Epoch AI Independent Record for Muse Spark 1.1 on SimpleQA Verified Original — Epoch AI harness SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps Effort: xHigh Configuration: Mercor mini-swe-agent, 250 steps, 1 hour 3.9% mercor.com for Muse Spark 1.1 (xhigh) on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps (opens in a new tab) Archived copy (opens in a new tab) Mean pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Muse Spark 1.1 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps SWE Atlas Codebase QnA — Public; mini-swe-agent Effort: xHigh Configuration: mini-swe-agent harness 42.2% labs.scale.com for Muse Spark 1.1 (xHigh) on SWE Atlas Codebase QnA — Public; mini-swe-agent (opens in a new tab) Archived copy (opens in a new tab) Mean pass@1 Reported October 7, 2026 Benchmark leaderboard Scale AI Independent Record for Muse Spark 1.1 on SWE Atlas Codebase QnA — Public; mini-swe-agent SWE-bench Verified — Vals AI mini-swe-agent Effort: xHigh Configuration: mini-swe-agent harness 82.0% vals.ai for Muse Spark 1.1 (xhigh) on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for Muse Spark 1.1 on SWE-bench Verified — Vals AI mini-swe-agent SWE-bench Pro Private — Scale AI mini-swe-agent Configuration: mini-swe-agent harness 51.5% labs.scale.com for Muse Spark 1.1 on SWE-bench Pro Private — Scale AI mini-swe-agent (opens in a new tab) Archived copy (opens in a new tab) Public tasks resolved Reported October 7, 2026 Benchmark leaderboard Scale AI Independent Record for Muse Spark 1.1 on SWE-bench Pro Private — Scale AI mini-swe-agent SWE-bench Pro Public Effort: xHigh 61.5% dev.meta.ai for Muse Spark 1.1 (xhigh) on SWE-bench Pro Public (opens in a new tab) Public tasks resolved Reported July 9, 2026 Model page Meta Self-reported Record for Muse Spark 1.1 on SWE-bench Pro Public SWE-bench Pro Public — Scale AI mini-swe-agent Configuration: mini-swe-agent harness 61.5% labs.scale.com for Muse Spark 1.1 on SWE-bench Pro Public — Scale AI mini-swe-agent (opens in a new tab) Archived copy (opens in a new tab) Public tasks resolved Reported October 7, 2026 Benchmark leaderboard Scale AI Independent Record for Muse Spark 1.1 on SWE-bench Pro Public — Scale AI mini-swe-agent Terminal-Bench 2.1 — mini-swe-agent Effort: xHigh Configuration: mini-swe-agent harness 80.0% dev.meta.ai for Muse Spark 1.1 (xhigh) on Terminal-Bench 2.1 — mini-swe-agent (opens in a new tab) Terminal-Bench Accuracy Reported July 9, 2026 Model page Meta Self-reported Record for Muse Spark 1.1 on Terminal-Bench 2.1 — mini-swe-agent Terminal-Bench 2.1 — Vals AI Terminus 2 Effort: xHigh Configuration: Terminus-2 harness 69.3% vals.ai for Muse Spark 1.1 (xhigh) on Terminal-Bench 2.1 — Vals AI Terminus 2 (opens in a new tab) Archived copy (opens in a new tab) Terminal-Bench Accuracy Reported September 28, 2026 Benchmark leaderboard Vals AI Independent Record for Muse Spark 1.1 on Terminal-Bench 2.1 — Vals AI Terminus 2 Toolathlon Verified Effort: xHigh 75.6% dev.meta.ai for Muse Spark 1.1 (xhigh) on Toolathlon Verified (opens in a new tab) Tasks completed Reported July 9, 2026 Model page Meta Self-reported Record for Muse Spark 1.1 on Toolathlon Verified Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation Effort: xHigh Configuration: OpenHands harness 72.2% vals.ai for Muse Spark 1.1 (xhigh) on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab) Archived copy (opens in a new tab) Vibe Code Bench Score Reported October 6, 2026 Benchmark leaderboard Vals AI Independent Record for Muse Spark 1.1 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading Effort: xHigh Configuration: AllTools retrieval 40.5% sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Muse Spark 1.1 (xhigh) on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading (opens in a new tab) Archived copy (opens in a new tab) Task success rate Reported August 4, 2026 Evaluated July 23, 2026 Benchmark leaderboard Sierra Independent Sierra Research Record for Muse Spark 1.1 on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading