APEX-Agents Original 40.9% mercor.com for GLM-5.1 on APEX-Agents Original (opens in a new tab) Archived copy (opens in a new tab) Pass rate Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for GLM-5.1 on APEX-Agents Original AutomationBench 1.0.6 Effort: Max 6.2% zapier.com for GLM-5.1 (max) on AutomationBench 1.0.6 (opens in a new tab) Archived copy (opens in a new tab) Task pass rate Reported October 7, 2026 Benchmark leaderboard Zapier Independent Zapier AutomationBench Team Record for GLM-5.1 on AutomationBench 1.0.6 BrowseComp 68.0% z.ai for GLM-5.1 on BrowseComp BrowseComp (opens in a new tab) BrowseComp Accuracy Reported April 7, 2026 Launch post Z.ai Self-reported Record for GLM-5.1 on BrowseComp BrowseComp CyberGym Original 68.7% z.ai for GLM-5.1 on CyberGym Original (opens in a new tab) Vulnerability reproduction success Reported April 7, 2026 Launch post Z.ai Self-reported Record for GLM-5.1 on CyberGym Original DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps Configuration: Mercor mini-swe-agent, 500 steps, 2 hours 18.9% mercor.com for GLM-5.1 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab) Archived copy (opens in a new tab) DeepSWE Pass@1 Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for GLM-5.1 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps Finance Agent Benchmark 2 — October 2026 evaluation 44.8% vals.ai for GLM-5.1 on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab) Archived copy (opens in a new tab) Finance Agent Accuracy Reported October 6, 2026 Benchmark leaderboard Vals AI Independent Record for GLM-5.1 on Finance Agent Benchmark 2 — October 2026 evaluation GPQA Diamond 86.2% z.ai for GLM-5.1 on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab) GPQA Diamond Accuracy Reported April 7, 2026 Launch post Z.ai Self-reported Record for GLM-5.1 on Graduate-Level Google-Proof Q&A Diamond GPQA Diamond — Epoch AI harness Configuration: Epoch AI harness 89.9% epoch.ai for GLM-5.1 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) GPQA Diamond Accuracy Reported October 7, 2026 Evaluated August 10, 2026 at 5:44 PM UTC Benchmark leaderboard Epoch AI Independent Record for GLM-5.1 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness GPQA Diamond — Vals AI harness Configuration: Vals AI harness: mean of zero-shot and few-shot CoT 84.5% vals.ai for GLM-5.1 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab) Archived copy (opens in a new tab) GPQA Diamond Accuracy Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for GLM-5.1 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness HLAB October 2026 evaluation 0.0% vals.ai for GLM-5.1 on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab) Archived copy (opens in a new tab) HLAB Task Pass Rate Reported October 6, 2026 Benchmark leaderboard Vals AI Independent Record for GLM-5.1 on Harvey's Legal Agent Benchmark October 2026 evaluation Humanity's Last Exam Text only — Mercor single-shot Configuration: Mercor single-shot agent 29.4% mercor.com for GLM-5.1 on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab) Archived copy (opens in a new tab) Humanity's Last Exam Accuracy Reported October 7, 2026 Benchmark leaderboard Mercor Independent Record for GLM-5.1 on Humanity's Last Exam Text only — Mercor single-shot MCP Atlas Public, April 2026 update 75.6% labs.scale.com for GLM-5.1 on MCP Atlas Public, April 2026 update (opens in a new tab) Pass rate Reported September 24, 2026 Benchmark leaderboard Scale AI Independent Record for GLM-5.1 on MCP Atlas Public, April 2026 update MMLU-Pro Original — Vals AI harness Configuration: Vals AI harness 86.9% vals.ai for GLM-5.1 on MMLU-Pro Original — Vals AI harness (opens in a new tab) Archived copy (opens in a new tab) Accuracy Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for GLM-5.1 on MMLU-Pro Original — Vals AI harness NL2Repo Bench Original 42.7% z.ai for GLM-5.1 on NL2Repo Bench Original (opens in a new tab) Average test pass rate Reported April 7, 2026 Launch post Z.ai Self-reported Record for GLM-5.1 on NL2Repo Bench Original SimpleQA Verified Original — Epoch AI harness Configuration: Epoch AI harness 34.0% epoch.ai for GLM-5.1 on SimpleQA Verified Original — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Accuracy Reported October 7, 2026 Evaluated August 27, 2026 at 7:36 PM UTC Benchmark leaderboard Epoch AI Independent Record for GLM-5.1 on SimpleQA Verified Original — Epoch AI harness SWE-bench Verified — Epoch AI harness Configuration: Epoch AI harness 74.2% epoch.ai for GLM-5.1 on SWE-bench Verified — Epoch AI harness (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported October 7, 2026 Evaluated May 15, 2026 at 10:07 AM UTC Benchmark leaderboard Epoch AI Independent Record for GLM-5.1 on SWE-bench Verified — Epoch AI harness SWE-bench Verified — Vals AI mini-swe-agent Configuration: mini-swe-agent harness 76.4% vals.ai for GLM-5.1 on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab) Archived copy (opens in a new tab) Resolved Tasks Reported September 1, 2026 Benchmark leaderboard Vals AI Independent Record for GLM-5.1 on SWE-bench Verified — Vals AI mini-swe-agent SWE-bench Pro Public 58.4% z.ai for GLM-5.1 on SWE-bench Pro Public (opens in a new tab) Public tasks resolved Reported April 7, 2026 Launch post Z.ai Self-reported Record for GLM-5.1 on SWE-bench Pro Public Terminal-Bench 2.0 — Terminus-2 Configuration: Terminus-2 harness 63.5% z.ai for GLM-5.1 on Terminal-Bench 2.0 — Terminus-2 (opens in a new tab) Terminal-Bench Accuracy Reported April 7, 2026 Launch post Z.ai Self-reported Record for GLM-5.1 on Terminal-Bench 2.0 — Terminus-2 Terminal-Bench 2.0 — Vals AI Terminus 2 Configuration: Terminus-2 harness 53.9% vals.ai for GLM-5.1 on Terminal-Bench 2.0 — Vals AI Terminus 2 (opens in a new tab) Archived copy (opens in a new tab) Terminal-Bench Accuracy Reported June 4, 2026 Benchmark leaderboard Vals AI Independent Record for GLM-5.1 on Terminal-Bench 2.0 — Vals AI Terminus 2 Terminal-Bench 2.1 — Vals AI Terminus 2 Configuration: Terminus-2 harness 56.9% vals.ai for GLM-5.1 on Terminal-Bench 2.1 — Vals AI Terminus 2 (opens in a new tab) Archived copy (opens in a new tab) Terminal-Bench Accuracy Reported September 28, 2026 Benchmark leaderboard Vals AI Independent Record for GLM-5.1 on Terminal-Bench 2.1 — Vals AI Terminus 2 Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation Configuration: OpenHands harness 31.5% vals.ai for GLM-5.1 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab) Archived copy (opens in a new tab) Vibe Code Bench Score Reported October 6, 2026 Benchmark leaderboard Vals AI Independent Record for GLM-5.1 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation