APEX-Agents Original 24.9% mercor.com for Qwen3.5-397B-A17B on APEX-Agents Original (opens in a new tab) Archived copy (opens in a new tab) Pass rate Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Qwen3.5-397B-A17B on APEX-Agents Original CharXiv Descriptive and reasoning — Mercor single-shot Configuration: Mercor single-shot agent 91.6% mercor.com for Qwen3.5-397B-A17B on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab) Archived copy (opens in a new tab) CharXiv Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Qwen3.5-397B-A17B on CharXiv Descriptive and reasoning — Mercor single-shot DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps Configuration: Mercor mini-swe-agent, 500 steps, 2 hours 0.0% mercor.com for Qwen3.5-397B-A17B on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Qwen3.5-397B-A17B on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps GPQA Diamond 88.4% alibabacloud.com for Qwen3.5-397B-A17B on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab) GPQA Diamond Accuracy Reported February 17, 2026 Launch post Alibaba Cloud Community Self-reported Qwen Team Record for Qwen3.5-397B-A17B on Graduate-Level Google-Proof Q&A Diamond GPQA Diamond — Epoch AI harness Effort: None Configuration: Epoch AI harness 86.4% epoch.ai for Qwen3.5-397B-A17B (none) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) GPQA Diamond Accuracy Reported October 7, 2026 Evaluated August 7, 2026 at 12:24 AM UTC Benchmark leaderboard Epoch AI Independent Record for Qwen3.5-397B-A17B on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness GPQA Diamond — Epoch AI harness Configuration: Epoch AI harness 85.9% epoch.ai for Qwen3.5-397B-A17B on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) GPQA Diamond Accuracy Reported October 7, 2026 Evaluated August 7, 2026 at 12:24 AM UTC Benchmark leaderboard Epoch AI Independent Record for Qwen3.5-397B-A17B on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness Humanity's Last Exam Full set — No tools Configuration: No tools 28.7% alibabacloud.com for Qwen3.5-397B-A17B on Humanity's Last Exam Full set — No tools (opens in a new tab) Humanity's Last Exam Accuracy Reported February 17, 2026 Launch post Alibaba Cloud Community Self-reported Qwen Team Record for Qwen3.5-397B-A17B on Humanity's Last Exam Full set — No tools Humanity's Last Exam Full set — With tools Configuration: With tools 48.3% alibabacloud.com for Qwen3.5-397B-A17B on Humanity's Last Exam Full set — With tools (opens in a new tab) Humanity's Last Exam Accuracy Reported February 17, 2026 Launch post Alibaba Cloud Community Self-reported Qwen Team Record for Qwen3.5-397B-A17B on Humanity's Last Exam Full set — With tools Humanity's Last Exam Text only — Mercor single-shot Configuration: Mercor single-shot agent 29.2% mercor.com for Qwen3.5-397B-A17B on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab) Archived copy (opens in a new tab) Humanity's Last Exam Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Qwen3.5-397B-A17B on Humanity's Last Exam Text only — Mercor single-shot IFBench Original 76.5% alibabacloud.com for Qwen3.5-397B-A17B on IFBench Original (opens in a new tab) Accuracy Reported February 17, 2026 Launch post Alibaba Cloud Community Self-reported Qwen Team Record for Qwen3.5-397B-A17B on IFBench Original MMMU 85.0% alibabacloud.com for Qwen3.5-397B-A17B on Massive Multi-discipline Multimodal Understanding MMMU (opens in a new tab) MMMU Accuracy Reported February 17, 2026 Launch post Alibaba Cloud Community Self-reported Qwen Team Record for Qwen3.5-397B-A17B on Massive Multi-discipline Multimodal Understanding MMMU MedXpertQA MM — Mercor single-shot Configuration: Mercor single-shot agent 65.8% mercor.com for Qwen3.5-397B-A17B on MedXpertQA MM — Mercor single-shot (opens in a new tab) Archived copy (opens in a new tab) Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Qwen3.5-397B-A17B on MedXpertQA MM — Mercor single-shot MMLU-Pro Original 87.8% alibabacloud.com for Qwen3.5-397B-A17B on MMLU-Pro Original (opens in a new tab) Accuracy Reported February 17, 2026 Launch post Alibaba Cloud Community Self-reported Qwen Team Record for Qwen3.5-397B-A17B on MMLU-Pro Original MMLU-Pro Original — Mercor single-shot Configuration: Mercor single-shot agent 88.0% mercor.com for Qwen3.5-397B-A17B on MMLU-Pro Original — Mercor single-shot (opens in a new tab) Archived copy (opens in a new tab) Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Qwen3.5-397B-A17B on MMLU-Pro Original — Mercor single-shot SWE-bench Multilingual 69.3% alibabacloud.com for Qwen3.5-397B-A17B on SWE-bench Multilingual (opens in a new tab) Resolved Tasks Reported February 17, 2026 Launch post Alibaba Cloud Community Self-reported Qwen Team Record for Qwen3.5-397B-A17B on SWE-bench Multilingual SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps Configuration: Mercor mini-swe-agent, 1000 steps, 3 hours 61.7% mercor.com for Qwen3.5-397B-A17B on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Qwen3.5-397B-A17B on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps SWE-bench Verified 76.4% alibabacloud.com for Qwen3.5-397B-A17B on SWE-bench Verified (opens in a new tab) Resolved Tasks Reported February 17, 2026 Launch post Alibaba Cloud Community Self-reported Qwen Team Record for Qwen3.5-397B-A17B on SWE-bench Verified SWE-bench Verified — Mercor mini-swe-agent, 1000 steps Configuration: Mercor mini-swe-agent, 1000 steps, 3 hours 72.1% mercor.com for Qwen3.5-397B-A17B on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Qwen3.5-397B-A17B on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps Terminal-Bench 2.1 — Mercor Terminus 2 Configuration: Mercor Terminus 2, 1000 steps, 3 hours 53.9% mercor.com for Qwen3.5-397B-A17B on Terminal-Bench 2.1 — Mercor Terminus 2 (opens in a new tab) Archived copy (opens in a new tab) Terminal-Bench Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for Qwen3.5-397B-A17B on Terminal-Bench 2.1 — Mercor Terminus 2 Toolathlon Verified 40.7% toolathlon.xyz for Qwen3.5-397B-A17B on Toolathlon Verified (opens in a new tab) Archived copy (opens in a new tab) Tasks completed Reported July 30, 2026 Benchmark leaderboard Toolathlon Independent Toolathlon Authors Record for Qwen3.5-397B-A17B on Toolathlon Verified τ³-bench τ³ — Airline Reported as: enabled 81.5% sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Qwen3.5-397B-A17B (enabled) on τ³-bench τ³ — Airline (opens in a new tab) Archived copy (opens in a new tab) Task success rate Reported March 2, 2026 Evaluated February 27, 2026 Benchmark leaderboard Sierra Independent Sierra Research Record for Qwen3.5-397B-A17B on τ³-bench τ³ — Airline τ³-bench τ³ — Banking, text-embedding-3-large retrieval, v1.0.1 grading Reported as: enabled Configuration: text-embedding-3-large retrieval 9.8% sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Qwen3.5-397B-A17B (enabled) on τ³-bench τ³ — Banking, text-embedding-3-large retrieval, v1.0.1 grading (opens in a new tab) Archived copy (opens in a new tab) Task success rate Reported March 2, 2026 Evaluated February 27, 2026 Benchmark leaderboard Sierra Independent Sierra Research Record for Qwen3.5-397B-A17B on τ³-bench τ³ — Banking, text-embedding-3-large retrieval, v1.0.1 grading τ³-bench τ³ — Retail Reported as: enabled 84.4% sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Qwen3.5-397B-A17B (enabled) on τ³-bench τ³ — Retail (opens in a new tab) Archived copy (opens in a new tab) Task success rate Reported March 2, 2026 Evaluated February 27, 2026 Benchmark leaderboard Sierra Independent Sierra Research Record for Qwen3.5-397B-A17B on τ³-bench τ³ — Retail τ³-bench τ³ — Telecom Reported as: enabled 97.8% sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Qwen3.5-397B-A17B (enabled) on τ³-bench τ³ — Telecom (opens in a new tab) Archived copy (opens in a new tab) Task success rate Reported March 2, 2026 Evaluated February 27, 2026 Benchmark leaderboard Sierra Independent Sierra Research Record for Qwen3.5-397B-A17B on τ³-bench τ³ — Telecom