Benchmarks

107 results

Benchmark results for SpaceXAI
ModelBenchmarkScoreSourceRegistry No.
Grok 4.5 (high)GPQA Diamond — Epoch AI harness93.4%epoch.ai for Grok 4.5 (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Grok 4.5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness40001
Grok 4.5 (high)APEX-Agents Original56.2%mercor.com for Grok 4.5 (high) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on APEX-Agents Original40001
Grok 4.5 (high)GPQA Diamond — Mercor single-shot92.4%mercor.com for Grok 4.5 (high) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot40001
Grok 4.5 (high)SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps87.7%mercor.com for Grok 4.5 (high) on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps40001
Grok 4.5 (high)MMMU-Pro 1,730 questions — Mercor single-shot79.0%mercor.com for Grok 4.5 (high) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on MMMU-Pro 1,730 questions — Mercor single-shot40001
Grok 4.5 (high)SimpleQA Verified Original — Epoch AI harness48.3%epoch.ai for Grok 4.5 (high) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Grok 4.5 on SimpleQA Verified Original — Epoch AI harness40001
Grok 4.5 (high)Terminal-Bench 2.1 — Mercor Terminus 279.0%mercor.com for Grok 4.5 (high) on Terminal-Bench 2.1 — Mercor Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on Terminal-Bench 2.1 — Mercor Terminus 240001
Grok 4.5 (high)MedXpertQA MM — Mercor single-shot69.5%mercor.com for Grok 4.5 (high) on MedXpertQA MM — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on MedXpertQA MM — Mercor single-shot40001
Grok 4.5 (High)Riemann-bench October 2026 leaderboard38.4%surgehq.ai for Grok 4.5 (High) on Riemann-bench October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Riemann-bench Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Grok 4.5 on Riemann-bench October 2026 leaderboard40001
Grok 4.5 (high)DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps49.3%mercor.com for Grok 4.5 (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps40001
Grok 4.5 (high)BrowseComp 130-question subset — Mercor web research agent75.8%mercor.com for Grok 4.5 (high) on BrowseComp 130-question subset — Mercor web research agent (opens in a new tab)Archived copy (opens in a new tab)BrowseComp AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on BrowseComp 130-question subset — Mercor web research agent40001
Grok 4.5 (high)MMLU-Pro Original — Mercor single-shot88.2%mercor.com for Grok 4.5 (high) on MMLU-Pro Original — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on MMLU-Pro Original — Mercor single-shot40001
Grok 4.5 (high)Humanity's Last Exam Text only — Mercor single-shot41.9%mercor.com for Grok 4.5 (high) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on Humanity's Last Exam Text only — Mercor single-shot40001
Grok 4.5 (high)CharXiv Descriptive and reasoning — Mercor single-shot92.8%mercor.com for Grok 4.5 (high) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)CharXiv AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on CharXiv Descriptive and reasoning — Mercor single-shot40001
Grok 4.5 (high)SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps41.9%mercor.com for Grok 4.5 (high) on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps40001
Grok 4.5 (high)SWE-bench Verified — Mercor mini-swe-agent, 1000 steps81.7%mercor.com for Grok 4.5 (high) on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps40001
Grok 4.5 (High)Chartography October 2026 leaderboard17.0%surgehq.ai for Grok 4.5 (High) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Grok 4.5 on Chartography October 2026 leaderboard40001
Grok 4.6 (xhigh)MMMU-Pro 1,730 questions — Mercor single-shot80.5%mercor.com for Grok 4.6 (xhigh) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Benchmark leaderboardMercorIndependentRecord for Grok 4.6 on MMMU-Pro 1,730 questions — Mercor single-shot40002
Grok 4.6 (xhigh)SWE-bench Verified — Mercor mini-swe-agent, 1000 steps84.6%mercor.com for Grok 4.6 (xhigh) on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Grok 4.6 on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps40002
Grok 4.6 (high)DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps63.7%mercor.com for Grok 4.6 (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for Grok 4.6 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps40002
Grok 4.6 (xhigh)Humanity's Last Exam Text only — Mercor single-shot41.3%mercor.com for Grok 4.6 (xhigh) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.6 on Humanity's Last Exam Text only — Mercor single-shot40002
Grok 4.6FrontierSWE 2 — October 2026 evaluation25.3%frontierswe.com for Grok 4.6 on FrontierSWE 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)FrontierSWE ScoreReported Benchmark leaderboardProximalIndependentRecord for Grok 4.6 on FrontierSWE 2 — October 2026 evaluation40002
Grok 4.6 (high)CWE-bench 1 — OpenCode57.0%cwe-bench.com for Grok 4.6 (high) on CWE-bench 1 — OpenCode (opens in a new tab)Archived copy (opens in a new tab)CWE-bench Programmatic Pass@1Reported Benchmark leaderboardCollinear AIIndependentRecord for Grok 4.6 on CWE-bench 1 — OpenCode40002
Grok 4.6 (xhigh)CharXiv Descriptive and reasoning — Mercor single-shot92.9%mercor.com for Grok 4.6 (xhigh) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)CharXiv AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.6 on CharXiv Descriptive and reasoning — Mercor single-shot40002
Grok 4.6 (xhigh)DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps24.8%mercor.com for Grok 4.6 (xhigh) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for Grok 4.6 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps40002
Grok 4.6 (xhigh)GPQA Diamond — Epoch AI harness93.2%epoch.ai for Grok 4.6 (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Grok 4.6 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness40002
Grok 4.6 (xhigh)SimpleQA Verified Original — Epoch AI harness48.9%epoch.ai for Grok 4.6 (xhigh) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Grok 4.6 on SimpleQA Verified Original — Epoch AI harness40002
Grok 4.6 (low)CursorBench 4.033.4%cursor.com for Grok 4.6 (low) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Grok 4.6 on CursorBench 4.040002
Grok 4.6 (xhigh)MMLU-Pro Original — Mercor single-shot89.4%mercor.com for Grok 4.6 (xhigh) on MMLU-Pro Original — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.6 on MMLU-Pro Original — Mercor single-shot40002
Grok 4.6 (high)SimpleQA Verified Original — Epoch AI harness49.3%epoch.ai for Grok 4.6 (high) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Grok 4.6 on SimpleQA Verified Original — Epoch AI harness40002
Grok 4.6 (xhigh)GPQA Diamond — Mercor single-shot93.8%mercor.com for Grok 4.6 (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.6 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot40002
Grok 4.6 (xhigh)CursorBench 4.041.4%cursor.com for Grok 4.6 (xhigh) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Grok 4.6 on CursorBench 4.040002
Grok 4.6 (xhigh)Terminal-Bench 4.0 — Mercor mini-swe-agent25.3%mercor.com for Grok 4.6 (xhigh) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.6 on Terminal-Bench 4.0 — Mercor mini-swe-agent40002
Grok 4.6 (xhigh)APEX-Agents Original65.3%mercor.com for Grok 4.6 (xhigh) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for Grok 4.6 on APEX-Agents Original40002
Grok 4.6 (medium)CursorBench 4.036.1%cursor.com for Grok 4.6 (medium) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Grok 4.6 on CursorBench 4.040002
Grok 4.6 (xhigh)MedXpertQA MM — Mercor single-shot75.2%mercor.com for Grok 4.6 (xhigh) on MedXpertQA MM — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.6 on MedXpertQA MM — Mercor single-shot40002
Grok 4.6 (xhigh)BrowseComp 130-question subset — Mercor web research agent84.0%mercor.com for Grok 4.6 (xhigh) on BrowseComp 130-question subset — Mercor web research agent (opens in a new tab)Archived copy (opens in a new tab)BrowseComp AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.6 on BrowseComp 130-question subset — Mercor web research agent40002
Grok 4.6 (xHigh)Chartography October 2026 leaderboard20.5%surgehq.ai for Grok 4.6 (xHigh) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Grok 4.6 on Chartography October 2026 leaderboard40002
Grok 4.6 (xhigh)SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps92.7%mercor.com for Grok 4.6 (xhigh) on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Grok 4.6 on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps40002
Grok 4.6 (high)GPQA Diamond — Epoch AI harness94.0%epoch.ai for Grok 4.6 (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Grok 4.6 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness40002
Grok 4.6 (xhigh)SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps50.3%mercor.com for Grok 4.6 (xhigh) on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardMercorIndependentRecord for Grok 4.6 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps40002
Grok 4.7 (xhigh)BrowseComp 130-question subset — Mercor web research agent75.8%mercor.com for Grok 4.7 (xhigh) on BrowseComp 130-question subset — Mercor web research agent (opens in a new tab)Archived copy (opens in a new tab)BrowseComp AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.7 on BrowseComp 130-question subset — Mercor web research agent40003
Grok 4.7 (xhigh)SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps84.2%mercor.com for Grok 4.7 (xhigh) on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Grok 4.7 on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps40003
Grok 4.7 (medium)CursorBench 4.041.6%cursor.com for Grok 4.7 (medium) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for Grok 4.7 on CursorBench 4.040003
Grok 4.7 (xhigh)DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps33.3%mercor.com for Grok 4.7 (xhigh) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for Grok 4.7 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps40003
Grok 4.7 (high)CWE-bench 1 — OpenCode68.0%cwe-bench.com for Grok 4.7 (high) on CWE-bench 1 — OpenCode (opens in a new tab)Archived copy (opens in a new tab)CWE-bench Programmatic Pass@1Reported Benchmark leaderboardCollinear AIIndependentRecord for Grok 4.7 on CWE-bench 1 — OpenCode40003
Grok 4.7 (xhigh)SWE-bench Verified — Mercor mini-swe-agent, 1000 steps79.1%mercor.com for Grok 4.7 (xhigh) on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Grok 4.7 on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps40003
Grok 4.7 (xHigh)Chartography October 2026 leaderboard14.7%surgehq.ai for Grok 4.7 (xHigh) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Grok 4.7 on Chartography October 2026 leaderboard40003
Grok 4.7FrontierSWE 2 — October 2026 evaluation29.5%frontierswe.com for Grok 4.7 on FrontierSWE 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)FrontierSWE ScoreReported Benchmark leaderboardProximalIndependentRecord for Grok 4.7 on FrontierSWE 2 — October 2026 evaluation40003
Grok 4.7 (xhigh)Terminal-Bench 4.0 — Mercor mini-swe-agent6.6%mercor.com for Grok 4.7 (xhigh) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.7 on Terminal-Bench 4.0 — Mercor mini-swe-agent40003