Benchmarks

22 results across 17 benchmarks

Benchmark results for GLM-5.1
BenchmarkScoreSource
APEX-Agents Original40.9%mercor.com for GLM-5.1 on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for GLM-5.1 on APEX-Agents Original
AutomationBench 1.0.6Effort: Max6.2%zapier.com for GLM-5.1 (max) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GLM-5.1 on AutomationBench 1.0.6
BrowseComp68.0%z.ai for GLM-5.1 on BrowseComp BrowseComp (opens in a new tab)BrowseComp AccuracyReported Launch postZ.aiSelf-reportedRecord for GLM-5.1 on BrowseComp BrowseComp
CyberGym Original68.7%z.ai for GLM-5.1 on CyberGym Original (opens in a new tab)Vulnerability reproduction successReported Launch postZ.aiSelf-reportedRecord for GLM-5.1 on CyberGym Original
DeepSWE 1.1 — Mercor mini-swe-agent, 500 stepsConfiguration: Mercor mini-swe-agent, 500 steps, 2 hours18.9%mercor.com for GLM-5.1 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for GLM-5.1 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps
Finance Agent Benchmark 2 — October 2026 evaluation44.8%vals.ai for GLM-5.1 on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Finance Agent AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-5.1 on Finance Agent Benchmark 2 — October 2026 evaluation
GPQA Diamond86.2%z.ai for GLM-5.1 on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Launch postZ.aiSelf-reportedRecord for GLM-5.1 on Graduate-Level Google-Proof Q&A Diamond
GPQA Diamond — Epoch AI harnessConfiguration: Epoch AI harness89.9%epoch.ai for GLM-5.1 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GLM-5.1 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Vals AI harnessConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT84.5%vals.ai for GLM-5.1 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-5.1 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
HLAB October 2026 evaluation0.0%vals.ai for GLM-5.1 on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)HLAB Task Pass RateReported Benchmark leaderboardVals AIIndependentRecord for GLM-5.1 on Harvey's Legal Agent Benchmark October 2026 evaluation
Humanity's Last Exam Text only — Mercor single-shotConfiguration: Mercor single-shot agent29.4%mercor.com for GLM-5.1 on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for GLM-5.1 on Humanity's Last Exam Text only — Mercor single-shot
MCP Atlas Public, April 2026 update75.6%labs.scale.com for GLM-5.1 on MCP Atlas Public, April 2026 update (opens in a new tab)Pass rateReported Benchmark leaderboardScale AIIndependentRecord for GLM-5.1 on MCP Atlas Public, April 2026 update
MMLU-Pro Original — Vals AI harnessConfiguration: Vals AI harness86.9%vals.ai for GLM-5.1 on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-5.1 on MMLU-Pro Original — Vals AI harness
NL2Repo Bench Original42.7%z.ai for GLM-5.1 on NL2Repo Bench Original (opens in a new tab)Average test pass rateReported Launch postZ.aiSelf-reportedRecord for GLM-5.1 on NL2Repo Bench Original
SimpleQA Verified Original — Epoch AI harnessConfiguration: Epoch AI harness34.0%epoch.ai for GLM-5.1 on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GLM-5.1 on SimpleQA Verified Original — Epoch AI harness
SWE-bench Verified — Epoch AI harnessConfiguration: Epoch AI harness74.2%epoch.ai for GLM-5.1 on SWE-bench Verified — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GLM-5.1 on SWE-bench Verified — Epoch AI harness
SWE-bench Verified — Vals AI mini-swe-agentConfiguration: mini-swe-agent harness76.4%vals.ai for GLM-5.1 on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardVals AIIndependentRecord for GLM-5.1 on SWE-bench Verified — Vals AI mini-swe-agent
SWE-bench Pro Public58.4%z.ai for GLM-5.1 on SWE-bench Pro Public (opens in a new tab)Public tasks resolvedReported Launch postZ.aiSelf-reportedRecord for GLM-5.1 on SWE-bench Pro Public
Terminal-Bench 2.0 — Terminus-2Configuration: Terminus-2 harness63.5%z.ai for GLM-5.1 on Terminal-Bench 2.0 — Terminus-2 (opens in a new tab)Terminal-Bench AccuracyReported Launch postZ.aiSelf-reportedRecord for GLM-5.1 on Terminal-Bench 2.0 — Terminus-2
Terminal-Bench 2.0 — Vals AI Terminus 2Configuration: Terminus-2 harness53.9%vals.ai for GLM-5.1 on Terminal-Bench 2.0 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-5.1 on Terminal-Bench 2.0 — Vals AI Terminus 2
Terminal-Bench 2.1 — Vals AI Terminus 2Configuration: Terminus-2 harness56.9%vals.ai for GLM-5.1 on Terminal-Bench 2.1 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-5.1 on Terminal-Bench 2.1 — Vals AI Terminus 2
Vibe Code Bench 1.1 — OpenHands, October 2026 evaluationConfiguration: OpenHands harness31.5%vals.ai for GLM-5.1 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for GLM-5.1 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation