Benchmarks

34 results across 22 benchmarks

Benchmark results for Grok 4.5
BenchmarkScoreSource
APEX-Agents OriginalEffort: High56.2%mercor.com for Grok 4.5 (high) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on APEX-Agents Original
BrowseComp 130-question subset — Mercor web research agentEffort: HighConfiguration: Mercor web research agent, 100 steps, 3 hours75.8%mercor.com for Grok 4.5 (high) on BrowseComp 130-question subset — Mercor web research agent (opens in a new tab)Archived copy (opens in a new tab)BrowseComp AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on BrowseComp 130-question subset — Mercor web research agent
Chartography October 2026 leaderboardEffort: High17.0%surgehq.ai for Grok 4.5 (High) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Grok 4.5 on Chartography October 2026 leaderboard
CharXiv Descriptive and reasoning — Mercor single-shotEffort: HighConfiguration: Mercor single-shot agent92.8%mercor.com for Grok 4.5 (high) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)CharXiv AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on CharXiv Descriptive and reasoning — Mercor single-shot
DeepSWE 1.1 — Mercor mini-swe-agent, 500 stepsEffort: HighConfiguration: Mercor mini-swe-agent, 500 steps, 2 hours49.3%mercor.com for Grok 4.5 (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps
Finance Agent Benchmark 2 — October 2026 evaluationEffort: High48.3%vals.ai for Grok 4.5 (high) on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Finance Agent AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Grok 4.5 on Finance Agent Benchmark 2 — October 2026 evaluation
GPQA Diamond — Epoch AI harnessEffort: HighConfiguration: Epoch AI harness93.4%epoch.ai for Grok 4.5 (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Grok 4.5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Mercor single-shotEffort: HighConfiguration: Mercor single-shot agent92.4%mercor.com for Grok 4.5 (high) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot
GPQA Diamond — Vals AI harnessEffort: HighConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT92.9%vals.ai for Grok 4.5 (high) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Grok 4.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
HLAB October 2026 evaluationEffort: High12.9%vals.ai for Grok 4.5 (high) on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)HLAB Task Pass RateReported Benchmark leaderboardVals AIIndependentRecord for Grok 4.5 on Harvey's Legal Agent Benchmark October 2026 evaluation
Humanity's Last Exam Text only — Mercor single-shotEffort: HighConfiguration: Mercor single-shot agent41.9%mercor.com for Grok 4.5 (high) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on Humanity's Last Exam Text only — Mercor single-shot
MedXpertQA MM — Mercor single-shotEffort: HighConfiguration: Mercor single-shot agent69.5%mercor.com for Grok 4.5 (high) on MedXpertQA MM — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on MedXpertQA MM — Mercor single-shot
MMLU-Pro Original — Mercor single-shotEffort: HighConfiguration: Mercor single-shot agent88.2%mercor.com for Grok 4.5 (high) on MMLU-Pro Original — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on MMLU-Pro Original — Mercor single-shot
MMLU-Pro Original — Vals AI harnessEffort: HighConfiguration: Vals AI harness89.2%vals.ai for Grok 4.5 (high) on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Grok 4.5 on MMLU-Pro Original — Vals AI harness
MMMU-Pro 1,730 questions — Mercor single-shotEffort: HighConfiguration: Mercor single-shot agent79.0%mercor.com for Grok 4.5 (high) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on MMMU-Pro 1,730 questions — Mercor single-shot
MMMU-Pro Vals AI harnessEffort: HighConfiguration: Vals AI harness61.8%vals.ai for Grok 4.5 (high) on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for Grok 4.5 on MMMU-Pro Vals AI harness
PostTrainBench 1.1 — Cursor CLIEffort: HighConfiguration: Cursor CLI harness23.5%posttrainbench.com for Grok 4.5 (High) on PostTrainBench 1.1 — Cursor CLI (opens in a new tab)Archived copy (opens in a new tab)PostTrainBench Weighted AggregateReported Benchmark leaderboardPostTrainBenchIndependentPostTrainBench TeamRecord for Grok 4.5 on PostTrainBench 1.1 — Cursor CLI
PostTrainBench 1.2 — Cursor CLIEffort: HighConfiguration: Cursor CLI harness22.6%posttrainbench.com for Grok 4.5 (High) on PostTrainBench 1.2 — Cursor CLI (opens in a new tab)Archived copy (opens in a new tab)PostTrainBench Weighted AggregateReported Benchmark leaderboardPostTrainBenchIndependentPostTrainBench TeamRecord for Grok 4.5 on PostTrainBench 1.2 — Cursor CLI
Riemann-bench October 2026 leaderboardEffort: High38.4%surgehq.ai for Grok 4.5 (High) on Riemann-bench October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Riemann-bench Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Grok 4.5 on Riemann-bench October 2026 leaderboard
SimpleQA Verified Original — Epoch AI harnessEffort: HighConfiguration: Epoch AI harness48.3%epoch.ai for Grok 4.5 (high) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Grok 4.5 on SimpleQA Verified Original — Epoch AI harness
SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 stepsEffort: HighConfiguration: Mercor mini-swe-agent, 250 steps, 1 hour41.9%mercor.com for Grok 4.5 (high) on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
SWE-bench MultilingualEffort: High78.0%cursor.com for Grok 4.5 (high) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Model cardSpaceXAI and CursorSelf-reportedCursorRecord for Grok 4.5 on SWE-bench Multilingual
SWE-bench Multilingual — Mercor mini-swe-agent, 1000 stepsEffort: HighConfiguration: Mercor mini-swe-agent, 1000 steps, 3 hours87.7%mercor.com for Grok 4.5 (high) on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps
SWE-bench Verified — Mercor mini-swe-agent, 1000 stepsEffort: HighConfiguration: Mercor mini-swe-agent, 1000 steps, 3 hours81.7%mercor.com for Grok 4.5 (high) on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps
SWE-bench Verified — Vals AI mini-swe-agentEffort: HighConfiguration: mini-swe-agent harness86.6%vals.ai for Grok 4.5 (high) on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardVals AIIndependentRecord for Grok 4.5 on SWE-bench Verified — Vals AI mini-swe-agent
SWE-bench Pro Public64.7%x.ai for Grok 4.5 on SWE-bench Pro Public (opens in a new tab)Public tasks resolvedReported Launch postSpaceXAISelf-reportedRecord for Grok 4.5 on SWE-bench Pro Public
Terminal-Bench 2.183.3%x.ai for Grok 4.5 on Terminal-Bench 2.1 (opens in a new tab)Terminal-Bench AccuracyReported Launch postSpaceXAISelf-reportedRecord for Grok 4.5 on Terminal-Bench 2.1
Terminal-Bench 2.1 — Mercor Terminus 2Effort: HighConfiguration: Mercor Terminus 2, 1000 steps, 3 hours79.0%mercor.com for Grok 4.5 (high) on Terminal-Bench 2.1 — Mercor Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.5 on Terminal-Bench 2.1 — Mercor Terminus 2
Terminal-Bench 2.1 — Vals AI Terminus 2Effort: HighConfiguration: Terminus-2 harness67.8%vals.ai for Grok 4.5 (high) on Terminal-Bench 2.1 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Grok 4.5 on Terminal-Bench 2.1 — Vals AI Terminus 2
Terminal-Bench 4.0 — Grok BuildEffort: HighConfiguration: Grok Build harness12.4%tbench.ai for Grok 4.5 (high) on Terminal-Bench 4.0 — Grok Build (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardTerminal-BenchIndependentTerminal-Bench TeamRecord for Grok 4.5 on Terminal-Bench 4.0 — Grok Build
Terminal-Bench 4.0 — Vals AI mini-swe-agentEffort: HighConfiguration: mini-swe-agent harness8.6%vals.ai for Grok 4.5 (high) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Grok 4.5 on Terminal-Bench 4.0 — Vals AI mini-swe-agent
Vals Index 2.1Effort: High44.7%vals.ai for Grok 4.5 (high) on Vals Index 2.1 (opens in a new tab)Archived copy (opens in a new tab)Vals Index GDP-weighted AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Grok 4.5 on Vals Index 2.1
Vibe Code Bench 1.1 — OpenHands, October 2026 evaluationEffort: HighConfiguration: OpenHands harness69.0%vals.ai for Grok 4.5 (high) on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for Grok 4.5 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation
τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 gradingEffort: HighConfiguration: AllTools retrieval47.9%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Grok 4.5 (high) on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Grok 4.5 on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading