Shared benchmarks

13
Shared benchmarks for Qwen3.7-Max and Qwen3.8-Max
BenchmarkQwen3.7-MaxQwen3.8-Max
  • 47.8%
  • 50.6%
Evaluation details for Finance Agent Benchmark 2 — October 2026 evaluation

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

  • 92.4%
  • 92.6%
Evaluation details for GPQA Diamond

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Qwen3.7-Max

Record for Qwen3.7-Max on Graduate-Level Google-Proof Q&A Diamond

Qwen3.8-Max

Record for Qwen3.8-Max on Graduate-Level Google-Proof Q&A Diamond
  • 90.9%
  • 92.7%
Evaluation details for GPQA Diamond — Epoch AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Qwen3.7-Max

Record for Qwen3.7-Max on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness

Qwen3.8-Max

Record for Qwen3.8-Max on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
  • 90.2%
  • 93.7%
Evaluation details for GPQA Diamond — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Qwen3.7-Max

Record for Qwen3.7-Max on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness

Qwen3.8-Max

Record for Qwen3.8-Max on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
  • 1.7%
  • 10.4%
Evaluation details for HLAB October 2026 evaluation

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Qwen3.7-Max

Record for Qwen3.7-Max on Harvey's Legal Agent Benchmark October 2026 evaluation

Qwen3.8-Max

Record for Qwen3.8-Max on Harvey's Legal Agent Benchmark October 2026 evaluation
  • 79.1%
  • 82.8%
Evaluation details for IFBench Original

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Qwen3.7-Max

Record for Qwen3.7-Max on IFBench Original

Qwen3.8-Max

Record for Qwen3.8-Max on IFBench Original
  • 89.3%
  • 88.6%
Evaluation details for MMLU-Pro Original — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Qwen3.7-Max

Record for Qwen3.7-Max on MMLU-Pro Original — Vals AI harness

Qwen3.8-Max

Record for Qwen3.8-Max on MMLU-Pro Original — Vals AI harness
MMLU-ProPotentially non-equivalent: Benchmark versions differ. Evaluator sets differ.
  • 89.6%Original · Qwen Team
  • 88.8%Original — Mercor single-shot · Mercor
Potentially non-equivalent · Evaluation details for MMLU-Pro

Benchmark versions differ. Evaluator sets differ. Evaluation methodology is not recorded by the registry.

Qwen3.7-Max

Record for Qwen3.7-Max on MMLU-Pro Original

Qwen3.8-Max

Record for Qwen3.8-Max on MMLU-Pro Original — Mercor single-shot
  • 15.2%
  • 15.2%
Evaluation details for Riemann-bench October 2026 leaderboard

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Qwen3.7-Max

Record for Qwen3.7-Max on Riemann-bench October 2026 leaderboard

Qwen3.8-Max

Record for Qwen3.8-Max on Riemann-bench October 2026 leaderboard
  • 55.8%
  • 45.8%
Evaluation details for SimpleQA Verified Original — Epoch AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

  • 68.8%
  • 85.6%
Evaluation details for SWE-bench Verified — Vals AI mini-swe-agent

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Qwen3.7-Max

Record for Qwen3.7-Max on SWE-bench Verified — Vals AI mini-swe-agent

Qwen3.8-Max

Record for Qwen3.8-Max on SWE-bench Verified — Vals AI mini-swe-agent
  • 61.0%
  • 67.4%
Evaluation details for Terminal-Bench 2.1 — Vals AI Terminus 2

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

Qwen3.7-Max

Record for Qwen3.7-Max on Terminal-Bench 2.1 — Vals AI Terminus 2

Qwen3.8-Max

Record for Qwen3.8-Max on Terminal-Bench 2.1 — Vals AI Terminus 2
  • 47.7%
  • 64.7%
Evaluation details for Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.