Benchmarks

9 results across 6 benchmarks

Benchmark results for Qwen3-Max-Thinking
BenchmarkScoreSource
GPQA Diamond87.4%alibabacloud.com for Qwen3-Max-Thinking on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3-Max-Thinking on Graduate-Level Google-Proof Q&A Diamond
GPQA Diamond — Vals AI harnessConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT84.8%vals.ai for Qwen3-Max-Thinking on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Qwen3-Max-Thinking on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
Humanity's Last Exam Full set — No toolsConfiguration: No tools30.2%alibabacloud.com for Qwen3-Max-Thinking on Humanity's Last Exam Full set — No tools (opens in a new tab)Humanity's Last Exam AccuracyReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3-Max-Thinking on Humanity's Last Exam Full set — No tools
Humanity's Last Exam Full set — With toolsConfiguration: With tools49.8%alibabacloud.com for Qwen3-Max-Thinking on Humanity's Last Exam Full set — With tools (opens in a new tab)Humanity's Last Exam AccuracyReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3-Max-Thinking on Humanity's Last Exam Full set — With tools
IFBench Original70.9%alibabacloud.com for Qwen3-Max-Thinking on IFBench Original (opens in a new tab)AccuracyReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3-Max-Thinking on IFBench Original
MMLU-Pro Original85.7%alibabacloud.com for Qwen3-Max-Thinking on MMLU-Pro Original (opens in a new tab)AccuracyReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3-Max-Thinking on MMLU-Pro Original
MMLU-Pro Original — Vals AI harnessConfiguration: Vals AI harness85.0%vals.ai for Qwen3-Max-Thinking on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Qwen3-Max-Thinking on MMLU-Pro Original — Vals AI harness
SWE-bench Verified75.3%alibabacloud.com for Qwen3-Max-Thinking on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3-Max-Thinking on SWE-bench Verified
Terminal-Bench 2.0 — Vals AI Terminus 2Configuration: Terminus-2 harness20.2%vals.ai for Qwen3-Max-Thinking on Terminal-Bench 2.0 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Qwen3-Max-Thinking on Terminal-Bench 2.0 — Vals AI Terminus 2