Benchmarks

7 results across 6 benchmarks

Benchmark results for Grok 4
BenchmarkScoreSource
GPQA Diamond — Epoch AI harnessConfiguration: Epoch AI harness87.0%epoch.ai for Grok 4 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardEpoch AIIndependentRecord for Grok 4 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Vals AI harnessConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT88.1%vals.ai for Grok 4 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Grok 4 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
MMLU-Pro Original — Vals AI harnessConfiguration: Vals AI harness85.3%vals.ai for Grok 4 on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Grok 4 on MMLU-Pro Original — Vals AI harness
MMMU-Pro Vals AI harnessConfiguration: Vals AI harness76.3%vals.ai for Grok 4 on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for Grok 4 on MMMU-Pro Vals AI harness
SWE-bench Verified — Vals AI mini-swe-agentConfiguration: mini-swe-agent harness57.8%vals.ai for Grok 4 on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardVals AIIndependentRecord for Grok 4 on SWE-bench Verified — Vals AI mini-swe-agent
Terminal-Bench 2.0 — Vals AI Terminus 2Configuration: Terminus-2 harness28.1%vals.ai for Grok 4 on Terminal-Bench 2.0 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Grok 4 on Terminal-Bench 2.0 — Vals AI Terminus 2
Toolathlon Original27.5%toolathlon.xyz for Grok 4 on Toolathlon Original (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for Grok 4 on Toolathlon Original