Shared benchmarks

5
Shared benchmarks for Grok 4 and Grok 4.5
BenchmarkGrok 4Grok 4.5
  • 87.0%
  • 93.4%
Evaluation details for GPQA Diamond — Epoch AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Grok 4

Record for Grok 4 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness

Grok 4.5

Record for Grok 4.5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
  • 88.1%
  • 92.9%
Evaluation details for GPQA Diamond — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Grok 4

Record for Grok 4 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness

Grok 4.5

Record for Grok 4.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
  • 85.3%
  • 89.2%
Evaluation details for MMLU-Pro Original — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Grok 4

Record for Grok 4 on MMLU-Pro Original — Vals AI harness

Grok 4.5

Record for Grok 4.5 on MMLU-Pro Original — Vals AI harness
  • 76.3%
  • 61.8%
Evaluation details for MMMU-Pro Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Grok 4

Record for Grok 4 on MMMU-Pro Vals AI harness

Grok 4.5

Record for Grok 4.5 on MMMU-Pro Vals AI harness
  • 57.8%
  • 86.6%
Evaluation details for SWE-bench Verified — Vals AI mini-swe-agent

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Grok 4

Record for Grok 4 on SWE-bench Verified — Vals AI mini-swe-agent

Grok 4.5

Record for Grok 4.5 on SWE-bench Verified — Vals AI mini-swe-agent