Muse Spark 1.1 vs Muse Spark 1.2
19 shared benchmark contexts with reported scores and primary source links.
Change models in the comparison toolShared benchmarks
19| Benchmark | Muse Spark 1.1 | Muse Spark 1.2 |
|---|---|---|
|
| |
Evaluation details for APEX-Agents OriginalThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Muse Spark 1.1 Muse Spark 1.2 | ||
|
| |
Evaluation details for Chartography October 2026 leaderboardThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for CharXiv Descriptive and reasoning — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
DeepSWE 1.1 — mini-swe-agentPotentially non-equivalent: Evaluator sets differ. |
|
|
Potentially non-equivalent · Evaluation details for DeepSWE 1.1 — mini-swe-agentEvaluator sets differ. Evaluation methodology is not recorded by the registry. | ||
DeepSWEPotentially non-equivalent: Benchmark versions differ. Evaluator sets differ. |
|
|
Potentially non-equivalent · Evaluation details for DeepSWEBenchmark versions differ. Evaluator sets differ. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for Finance Agent Benchmark 2 — October 2026 evaluationThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for HLAB October 2026 evaluationThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for JobBench Main 65 tasksThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Muse Spark 1.1 Muse Spark 1.2 | ||
|
| |
Evaluation details for MedXpertQA MM — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for MMLU-Pro Original — Vals AI harnessThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for MMMU-Pro 1,730 questions — Mercor single-shotThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for MMMU-Pro Vals AI harnessThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. Muse Spark 1.1 Muse Spark 1.2 | ||
|
| |
Evaluation details for Riemann-bench October 2026 leaderboardThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SimpleQA Verified Original — Epoch AI harnessThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
SWE Atlas Codebase QnA — Public; mini-swe-agentPotentially non-equivalent: Evaluator sets differ. |
|
|
Potentially non-equivalent · Evaluation details for SWE Atlas Codebase QnA — Public; mini-swe-agentEvaluator sets differ. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for SWE-bench Verified — Vals AI mini-swe-agentThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
|
| |
Evaluation details for Terminal-Bench 2.1 — Vals AI Terminus 2The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||
Toolathlon VerifiedPotentially non-equivalent: Evaluator sets differ. |
|
|
Potentially non-equivalent · Evaluation details for Toolathlon VerifiedEvaluator sets differ. Evaluation methodology is not recorded by the registry. Muse Spark 1.1 Muse Spark 1.2 | ||
|
| |
Evaluation details for Vibe Code Bench 1.1 — OpenHands, October 2026 evaluationThe recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry. | ||