| Muse Spark | SWE-bench Pro Private — Scale AI mini-swe-agent | 44.7% | labs.scale.com for Muse Spark on SWE-bench Pro Private — Scale AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Public tasks resolvedReported Benchmark leaderboardScale AIIndependentRecord for Muse Spark on SWE-bench Pro Private — Scale AI mini-swe-agent | 80001 |
| Muse Spark | Humanity's Last Exam Text only — Scale AI evaluation | 40.9% | labs.scale.com for Muse Spark on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Muse Spark on Humanity's Last Exam Text only — Scale AI evaluation | 80001 |
| Muse Spark | GPQA Diamond — Epoch AI harness | 89.8% | epoch.ai for Muse Spark on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Muse Spark on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness | 80001 |
| Muse Spark | SWE-bench Pro Public — Scale AI mini-swe-agent | 55.0% | labs.scale.com for Muse Spark on SWE-bench Pro Public — Scale AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Public tasks resolvedReported Benchmark leaderboardScale AIIndependentRecord for Muse Spark on SWE-bench Pro Public — Scale AI mini-swe-agent | 80001 |
| Muse Spark 1.1 (xHigh) | Chartography October 2026 leaderboard | 24.4% | surgehq.ai for Muse Spark 1.1 (xHigh) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Muse Spark 1.1 on Chartography October 2026 leaderboard | 80002 |
| Muse Spark 1.1 (xHigh) | SWE Atlas Codebase QnA — Public; mini-swe-agent | 42.2% | labs.scale.com for Muse Spark 1.1 (xHigh) on SWE Atlas Codebase QnA — Public; mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Muse Spark 1.1 on SWE Atlas Codebase QnA — Public; mini-swe-agent | 80002 |
| Muse Spark 1.1 | SWE-bench Pro Private — Scale AI mini-swe-agent | 51.5% | labs.scale.com for Muse Spark 1.1 on SWE-bench Pro Private — Scale AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Public tasks resolvedReported Benchmark leaderboardScale AIIndependentRecord for Muse Spark 1.1 on SWE-bench Pro Private — Scale AI mini-swe-agent | 80002 |
| Muse Spark 1.1 (xhigh) | MMMU-Pro 1,730 questions — Mercor single-shot | 81.3% | mercor.com for Muse Spark 1.1 (xhigh) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Benchmark leaderboardMercorIndependentRecord for Muse Spark 1.1 on MMMU-Pro 1,730 questions — Mercor single-shot | 80002 |
| Muse Spark 1.1 | SWE-bench Pro Public — Scale AI mini-swe-agent | 61.5% | labs.scale.com for Muse Spark 1.1 on SWE-bench Pro Public — Scale AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Public tasks resolvedReported Benchmark leaderboardScale AIIndependentRecord for Muse Spark 1.1 on SWE-bench Pro Public — Scale AI mini-swe-agent | 80002 |
| Muse Spark 1.1 (xhigh) | CharXiv Descriptive and reasoning — Mercor single-shot | 95.2% | mercor.com for Muse Spark 1.1 (xhigh) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)CharXiv AccuracyReported Benchmark leaderboardMercorIndependentRecord for Muse Spark 1.1 on CharXiv Descriptive and reasoning — Mercor single-shot | 80002 |
| Muse Spark 1.1 (xhigh) | GPQA Diamond — Mercor single-shot | 90.8% | mercor.com for Muse Spark 1.1 (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Muse Spark 1.1 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot | 80002 |
| Muse Spark 1.1 (xhigh) | DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps | 40.4% | mercor.com for Muse Spark 1.1 (xhigh) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for Muse Spark 1.1 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps | 80002 |
| Muse Spark 1.1 (xhigh) | MedXpertQA MM — Mercor single-shot | 77.0% | mercor.com for Muse Spark 1.1 (xhigh) on MedXpertQA MM — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Muse Spark 1.1 on MedXpertQA MM — Mercor single-shot | 80002 |
| Muse Spark 1.1 (xhigh) | APEX-Agents Original | 31.8% | mercor.com for Muse Spark 1.1 (xhigh) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for Muse Spark 1.1 on APEX-Agents Original | 80002 |
| Muse Spark 1.1 (xhigh) | MMLU-Pro Original — Mercor single-shot | 89.9% | mercor.com for Muse Spark 1.1 (xhigh) on MMLU-Pro Original — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Muse Spark 1.1 on MMLU-Pro Original — Mercor single-shot | 80002 |
| Muse Spark 1.1 (xHigh) | Riemann-bench October 2026 leaderboard | 20.8% | surgehq.ai for Muse Spark 1.1 (xHigh) on Riemann-bench October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Riemann-bench Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Muse Spark 1.1 on Riemann-bench October 2026 leaderboard | 80002 |
| Muse Spark 1.1 (xhigh) | SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps | 3.9% | mercor.com for Muse Spark 1.1 (xhigh) on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardMercorIndependentRecord for Muse Spark 1.1 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps | 80002 |
| Muse Spark 1.1 | SimpleQA Verified Original — Epoch AI harness | 57.8% | epoch.ai for Muse Spark 1.1 on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Muse Spark 1.1 on SimpleQA Verified Original — Epoch AI harness | 80002 |
| Muse Spark 1.2 (xhigh) | SimpleQA Verified Original — Epoch AI harness | 60.3% | epoch.ai for Muse Spark 1.2 (xhigh) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Muse Spark 1.2 on SimpleQA Verified Original — Epoch AI harness | 80003 |
| Muse Spark 1.2 (xHigh) | Riemann-bench October 2026 leaderboard | 23.2% | surgehq.ai for Muse Spark 1.2 (xHigh) on Riemann-bench October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Riemann-bench Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Muse Spark 1.2 on Riemann-bench October 2026 leaderboard | 80003 |
| Muse Spark 1.2 (xhigh) | BrowseComp 130-question subset — Mercor web research agent | 75.2% | mercor.com for Muse Spark 1.2 (xhigh) on BrowseComp 130-question subset — Mercor web research agent (opens in a new tab)Archived copy (opens in a new tab)BrowseComp AccuracyReported Benchmark leaderboardMercorIndependentRecord for Muse Spark 1.2 on BrowseComp 130-question subset — Mercor web research agent | 80003 |
| Muse Spark 1.2 (xHigh) | Chartography October 2026 leaderboard | 32.1% | surgehq.ai for Muse Spark 1.2 (xHigh) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Muse Spark 1.2 on Chartography October 2026 leaderboard | 80003 |
| Muse Spark 1.2 (xhigh) | MedXpertQA MM — Mercor single-shot | 75.7% | mercor.com for Muse Spark 1.2 (xhigh) on MedXpertQA MM — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Muse Spark 1.2 on MedXpertQA MM — Mercor single-shot | 80003 |
| Muse Spark 1.2 (xhigh) | APEX-Agents Original | 36.4% | mercor.com for Muse Spark 1.2 (xhigh) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for Muse Spark 1.2 on APEX-Agents Original | 80003 |
| Muse Spark 1.2 | FrontierSWE 2 — October 2026 evaluation | 12.0% | frontierswe.com for Muse Spark 1.2 on FrontierSWE 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)FrontierSWE ScoreReported Benchmark leaderboardProximalIndependentRecord for Muse Spark 1.2 on FrontierSWE 2 — October 2026 evaluation | 80003 |
| Muse Spark 1.2 (xhigh) | MMMU-Pro 1,730 questions — Mercor single-shot | 80.7% | mercor.com for Muse Spark 1.2 (xhigh) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Benchmark leaderboardMercorIndependentRecord for Muse Spark 1.2 on MMMU-Pro 1,730 questions — Mercor single-shot | 80003 |
| Muse Spark 1.2 (xhigh) | CharXiv Descriptive and reasoning — Mercor single-shot | 95.3% | mercor.com for Muse Spark 1.2 (xhigh) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)CharXiv AccuracyReported Benchmark leaderboardMercorIndependentRecord for Muse Spark 1.2 on CharXiv Descriptive and reasoning — Mercor single-shot | 80003 |
| Muse Glimmer 30B (xHigh) | Riemann-bench October 2026 leaderboard | 13.6% | surgehq.ai for Muse Glimmer 30B (xHigh) on Riemann-bench October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Riemann-bench Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Muse Glimmer 30B on Riemann-bench October 2026 leaderboard | 80004 |
| Muse Glimmer 30B (xHigh) | Chartography October 2026 leaderboard | 17.2% | surgehq.ai for Muse Glimmer 30B (xHigh) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Muse Glimmer 30B on Chartography October 2026 leaderboard | 80004 |
| Muse Spark 1.3 (low) | CursorBench 4.0 | 29.3% | cursor.com for Muse Spark 1.3 (low) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Muse Spark 1.3 on CursorBench 4.0 | 80005 |
| Muse Spark 1.3 (max) | AutomationBench 1.0.6 | 20.7% | zapier.com for Muse Spark 1.3 (max) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Muse Spark 1.3 on AutomationBench 1.0.6 | 80005 |
| Muse Spark 1.3 (max) | MedXpertQA MM — Mercor single-shot | 76.3% | mercor.com for Muse Spark 1.3 (max) on MedXpertQA MM — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Muse Spark 1.3 on MedXpertQA MM — Mercor single-shot | 80005 |
| Muse Spark 1.3 (xhigh) | APEX-Agents Original | 58.6% | mercor.com for Muse Spark 1.3 (xhigh) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for Muse Spark 1.3 on APEX-Agents Original | 80005 |
| Muse Spark 1.3 (medium) | CursorBench 4.0 | 32.6% | cursor.com for Muse Spark 1.3 (medium) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Muse Spark 1.3 on CursorBench 4.0 | 80005 |
| Muse Spark 1.3 (max) | APEX-Agents Original | 47.6% | mercor.com for Muse Spark 1.3 (max) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for Muse Spark 1.3 on APEX-Agents Original | 80005 |
| Muse Spark 1.3 (max) | CursorBench 4.0 | 41.6% | cursor.com for Muse Spark 1.3 (max) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Muse Spark 1.3 on CursorBench 4.0 | 80005 |
| Muse Spark 1.3 (xHigh) | Riemann-bench October 2026 leaderboard | 28.0% | surgehq.ai for Muse Spark 1.3 (xHigh) on Riemann-bench October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Riemann-bench Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Muse Spark 1.3 on Riemann-bench October 2026 leaderboard | 80005 |
| Muse Spark 1.3 (high) | CursorBench 4.0 | 33.4% | cursor.com for Muse Spark 1.3 (high) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Muse Spark 1.3 on CursorBench 4.0 | 80005 |
| Muse Spark 1.3 (max) | GPQA Diamond — Mercor single-shot | 91.3% | mercor.com for Muse Spark 1.3 (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Muse Spark 1.3 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot | 80005 |
| Muse Spark 1.3 (xHigh) | Chartography October 2026 leaderboard | 27.6% | surgehq.ai for Muse Spark 1.3 (xHigh) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Muse Spark 1.3 on Chartography October 2026 leaderboard | 80005 |
| Muse Spark 1.3 (high) | CWE-bench 1 — OpenCode | 55.0% | cwe-bench.com for Muse Spark 1.3 (high) on CWE-bench 1 — OpenCode (opens in a new tab)Archived copy (opens in a new tab)CWE-bench Programmatic Pass@1Reported Benchmark leaderboardCollinear AIIndependentRecord for Muse Spark 1.3 on CWE-bench 1 — OpenCode | 80005 |
| Muse Spark 1.3 (xhigh) | CursorBench 4.0 | 37.5% | cursor.com for Muse Spark 1.3 (xhigh) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Muse Spark 1.3 on CursorBench 4.0 | 80005 |
| Muse Spark 1.3 (max) | CharXiv Descriptive and reasoning — Mercor single-shot | 93.9% | mercor.com for Muse Spark 1.3 (max) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)CharXiv AccuracyReported Benchmark leaderboardMercorIndependentRecord for Muse Spark 1.3 on CharXiv Descriptive and reasoning — Mercor single-shot | 80005 |
| Muse Spark | Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation | 19.7% | vals.ai for Muse Spark on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for Muse Spark on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation | 80001 |
| Muse Spark 1.1 (xhigh) | Finance Agent Benchmark 2 — October 2026 evaluation | 57.2% | vals.ai for Muse Spark 1.1 (xhigh) on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Finance Agent AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Muse Spark 1.1 on Finance Agent Benchmark 2 — October 2026 evaluation | 80002 |
| Muse Spark 1.1 (xhigh) | HLAB October 2026 evaluation | 20.0% | vals.ai for Muse Spark 1.1 (xhigh) on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)HLAB Task Pass RateReported Benchmark leaderboardVals AIIndependentRecord for Muse Spark 1.1 on Harvey's Legal Agent Benchmark October 2026 evaluation | 80002 |
| Muse Spark 1.1 (xhigh) | Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation | 72.2% | vals.ai for Muse Spark 1.1 (xhigh) on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for Muse Spark 1.1 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation | 80002 |
| Muse Spark 1.2 (xhigh) | Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation | 79.1% | vals.ai for Muse Spark 1.2 (xhigh) on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for Muse Spark 1.2 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation | 80003 |
| Muse Spark 1.2 (xhigh) | Vals Index 2.1 | 49.3% | vals.ai for Muse Spark 1.2 (xhigh) on Vals Index 2.1 (opens in a new tab)Archived copy (opens in a new tab)Vals Index GDP-weighted AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Muse Spark 1.2 on Vals Index 2.1 | 80003 |
| Muse Spark 1.2 (xhigh) | Finance Agent Benchmark 2 — October 2026 evaluation | 60.6% | vals.ai for Muse Spark 1.2 (xhigh) on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Finance Agent AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Muse Spark 1.2 on Finance Agent Benchmark 2 — October 2026 evaluation | 80003 |