Benchmarks

22 results across 11 benchmarks

Benchmark results for GLM-5
BenchmarkScoreSource
BrowseCompReported as: thinking62.0%z.ai for GLM-5 (thinking) on BrowseComp BrowseComp (opens in a new tab)BrowseComp AccuracyReported Launch postZ.aiSelf-reportedRecord for GLM-5 on BrowseComp BrowseComp
CyberGym OriginalReported as: thinking43.2%z.ai for GLM-5 (thinking) on CyberGym Original (opens in a new tab)Vulnerability reproduction successReported Launch postZ.aiSelf-reportedRecord for GLM-5 on CyberGym Original
DeepSWE 1.1 — Mercor mini-swe-agent, 500 stepsConfiguration: Mercor mini-swe-agent, 500 steps, 2 hours2.1%mercor.com for GLM-5 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for GLM-5 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps
GPQA DiamondReported as: thinking86.0%z.ai for GLM-5 (thinking) on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Launch postZ.aiSelf-reportedRecord for GLM-5 on Graduate-Level Google-Proof Q&A Diamond
GPQA Diamond — Epoch AI harnessConfiguration: Epoch AI harness87.8%epoch.ai for GLM-5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GLM-5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Vals AI harnessReported as: thinkingConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT83.3%vals.ai for GLM-5 (thinking) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
MMLU-Pro Original — Vals AI harnessReported as: thinkingConfiguration: Vals AI harness86.0%vals.ai for GLM-5 (thinking) on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-5 on MMLU-Pro Original — Vals AI harness
SWE Atlas Codebase QnA — Public; mini-swe-agentConfiguration: mini-swe-agent harness20.5%labs.scale.com for GLM-5 on SWE Atlas Codebase QnA — Public; mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for GLM-5 on SWE Atlas Codebase QnA — Public; mini-swe-agent
SWE Atlas Refactoring — mini-swe-agentConfiguration: mini-swe-agent harness24.2%labs.scale.com for GLM-5 on SWE Atlas Refactoring — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for GLM-5 on SWE Atlas Refactoring — mini-swe-agent
SWE-bench MultilingualReported as: thinking73.3%z.ai for GLM-5 (thinking) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Launch postZ.aiSelf-reportedRecord for GLM-5 on SWE-bench Multilingual
SWE-bench Multilingual — mini-swe-agentConfiguration: mini-swe-agent harness69.7%github.com for GLM-5 on SWE-bench Multilingual — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark repositorySWE-benchIndependentSWE-bench TeamRecord for GLM-5 on SWE-bench Multilingual — mini-swe-agent
SWE-bench VerifiedReported as: thinking77.8%z.ai for GLM-5 (thinking) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postZ.aiSelf-reportedRecord for GLM-5 on SWE-bench Verified
SWE-bench Verified — Epoch AI harnessConfiguration: Epoch AI harness72.1%epoch.ai for GLM-5 on SWE-bench Verified — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GLM-5 on SWE-bench Verified — Epoch AI harness
SWE-bench Verified — mini-swe-agentEffort: HighConfiguration: mini-swe-agent harness72.8%github.com for GLM-5 (high) on SWE-bench Verified — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark repositorySWE-benchIndependentSWE-bench TeamRecord for GLM-5 on SWE-bench Verified — mini-swe-agent
SWE-bench Verified — Vals AI mini-swe-agentReported as: thinkingConfiguration: mini-swe-agent harness71.4%vals.ai for GLM-5 (thinking) on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardVals AIIndependentRecord for GLM-5 on SWE-bench Verified — Vals AI mini-swe-agent
Terminal-Bench 2.0 — Vals AI Terminus 2Reported as: thinkingConfiguration: Terminus-2 harness49.4%vals.ai for GLM-5 (thinking) on Terminal-Bench 2.0 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-5 on Terminal-Bench 2.0 — Vals AI Terminus 2
Toolathlon Original39.2%toolathlon.xyz for GLM-5 on Toolathlon Original (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for GLM-5 on Toolathlon Original
Vibe Code Bench 1.1 — OpenHands, October 2026 evaluationReported as: thinkingConfiguration: OpenHands harness23.4%vals.ai for GLM-5 (thinking) on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for GLM-5 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation
τ³-bench τ³ — AirlineReported as: enabled82.5%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for GLM-5 (enabled) on τ³-bench τ³ — Airline (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for GLM-5 on τ³-bench τ³ — Airline
τ³-bench τ³ — Banking, text-embedding-3-large retrieval, v1.0.1 gradingReported as: enabledConfiguration: text-embedding-3-large retrieval9.8%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for GLM-5 (enabled) on τ³-bench τ³ — Banking, text-embedding-3-large retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for GLM-5 on τ³-bench τ³ — Banking, text-embedding-3-large retrieval, v1.0.1 grading
τ³-bench τ³ — RetailReported as: enabled73.7%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for GLM-5 (enabled) on τ³-bench τ³ — Retail (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for GLM-5 on τ³-bench τ³ — Retail
τ³-bench τ³ — TelecomReported as: enabled86.8%sierra-tau-bench-public.s3.us-west-2.amazonaws.com for GLM-5 (enabled) on τ³-bench τ³ — Telecom (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for GLM-5 on τ³-bench τ³ — Telecom