Benchmarks

32 results across 21 benchmarks

Benchmark results for GLM-5.3-Flash
BenchmarkScoreSource
APEX-Agents OriginalEffort: Max52.8%mercor.com for GLM-5.3-Flash (max) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for GLM-5.3-Flash on APEX-Agents Original
AutomationBench 1.0.6Effort: Max48.8%autoclaw.z.ai for GLM-5.3-Flash (max) on AutomationBench 1.0.6 (opens in a new tab)Task pass rateReported Launch postAutoClaw Team (Z.ai)Self-reportedZ.aiRecord for GLM-5.3-Flash on AutomationBench 1.0.6
Chartography October 2026 leaderboardEffort: Max16.3%surgehq.ai for GLM-5.3-Flash (Max) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for GLM-5.3-Flash on Chartography October 2026 leaderboard
CharXiv Descriptive and reasoning — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent92.5%mercor.com for GLM-5.3-Flash (max) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)CharXiv AccuracyReported Benchmark leaderboardMercorIndependentRecord for GLM-5.3-Flash on CharXiv Descriptive and reasoning — Mercor single-shot
CursorBench 4.0Effort: Low26.9%cursor.com for GLM-5.3-Flash (low) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for GLM-5.3-Flash on CursorBench 4.0
CursorBench 4.0Effort: High31.1%cursor.com for GLM-5.3-Flash (high) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for GLM-5.3-Flash on CursorBench 4.0
CursorBench 4.0Effort: Max36.8%cursor.com for GLM-5.3-Flash (max) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for GLM-5.3-Flash on CursorBench 4.0
DeepSWE 1.1Effort: Max63.0%deepswe.datacurve.ai for GLM-5.3-Flash (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for GLM-5.3-Flash on DeepSWE 1.1
DeepSWE 1.1 — Mercor mini-swe-agent, 500 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 500 steps, 2 hours42.5%mercor.com for GLM-5.3-Flash (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for GLM-5.3-Flash on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps
Finance Agent Benchmark 2 — October 2026 evaluationEffort: Max57.9%vals.ai for GLM-5.3-Flash (max) on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Finance Agent AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-5.3-Flash on Finance Agent Benchmark 2 — October 2026 evaluation
FrontierSWE 2 — October 2026 evaluationConfiguration: Proximus harness, 5 trials, 20-hour budget18.1%frontierswe.com for GLM-5.3-Flash on FrontierSWE 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)FrontierSWE ScoreReported Benchmark leaderboardProximalIndependentRecord for GLM-5.3-Flash on FrontierSWE 2 — October 2026 evaluation
GPQA Diamond — Epoch AI harnessEffort: MaxConfiguration: Epoch AI harness90.2%epoch.ai for GLM-5.3-Flash (max) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GLM-5.3-Flash on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Vals AI harnessEffort: MaxConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT86.4%vals.ai for GLM-5.3-Flash (max) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-5.3-Flash on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
HLAB October 2026 evaluationEffort: Max6.7%vals.ai for GLM-5.3-Flash (max) on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)HLAB Task Pass RateReported Benchmark leaderboardVals AIIndependentRecord for GLM-5.3-Flash on Harvey's Legal Agent Benchmark October 2026 evaluation
Humanity's Last Exam Full set — With toolsEffort: MaxConfiguration: With tools55.3%autoclaw.z.ai for GLM-5.3-Flash (max) on Humanity's Last Exam Full set — With tools (opens in a new tab)Humanity's Last Exam AccuracyReported Launch postAutoClaw Team (Z.ai)Self-reportedZ.aiRecord for GLM-5.3-Flash on Humanity's Last Exam Full set — With tools
Humanity's Last Exam Text only — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent33.6%mercor.com for GLM-5.3-Flash (max) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for GLM-5.3-Flash on Humanity's Last Exam Text only — Mercor single-shot
MedXpertQA MM — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent73.7%mercor.com for GLM-5.3-Flash (max) on MedXpertQA MM — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for GLM-5.3-Flash on MedXpertQA MM — Mercor single-shot
MMLU-Pro Original — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent87.3%mercor.com for GLM-5.3-Flash (max) on MMLU-Pro Original — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for GLM-5.3-Flash on MMLU-Pro Original — Mercor single-shot
MMLU-Pro Original — Vals AI harnessEffort: MaxConfiguration: Vals AI harness86.1%vals.ai for GLM-5.3-Flash (max) on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-5.3-Flash on MMLU-Pro Original — Vals AI harness
MMMU-Pro 1,730 questions — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent78.4%mercor.com for GLM-5.3-Flash (max) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Benchmark leaderboardMercorIndependentRecord for GLM-5.3-Flash on MMMU-Pro 1,730 questions — Mercor single-shot
MMMU-Pro Vals AI harnessEffort: MaxConfiguration: Vals AI harness86.0%vals.ai for GLM-5.3-Flash (max) on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for GLM-5.3-Flash on MMMU-Pro Vals AI harness
NL2Repo Bench OriginalEffort: Max56.3%autoclaw.z.ai for GLM-5.3-Flash (max) on NL2Repo Bench Original (opens in a new tab)Average test pass rateReported Launch postAutoClaw Team (Z.ai)Self-reportedZ.aiRecord for GLM-5.3-Flash on NL2Repo Bench Original
PostTrainBench 1.2 — Claude CodeEffort: MaxConfiguration: Claude Code harness36.8%posttrainbench.com for GLM-5.3-Flash (Max) on PostTrainBench 1.2 — Claude Code (opens in a new tab)Archived copy (opens in a new tab)PostTrainBench Weighted AggregateReported Benchmark leaderboardPostTrainBenchIndependentPostTrainBench TeamRecord for GLM-5.3-Flash on PostTrainBench 1.2 — Claude Code
Riemann-bench October 2026 leaderboardEffort: Max8.8%surgehq.ai for GLM-5.3-Flash (Max) on Riemann-bench October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Riemann-bench Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for GLM-5.3-Flash on Riemann-bench October 2026 leaderboard
SWE-bench Multilingual — Mercor mini-swe-agent, 1000 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 1000 steps, 3 hours88.9%mercor.com for GLM-5.3-Flash (max) on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for GLM-5.3-Flash on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps
SWE-bench Verified — Vals AI mini-swe-agentEffort: MaxConfiguration: mini-swe-agent harness92.0%vals.ai for GLM-5.3-Flash (max) on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardVals AIIndependentRecord for GLM-5.3-Flash on SWE-bench Verified — Vals AI mini-swe-agent
Terminal-Bench 2.1 — Claude CodeEffort: MaxConfiguration: Claude Code harness84.3%autoclaw.z.ai for GLM-5.3-Flash (max) on Terminal-Bench 2.1 — Claude Code (opens in a new tab)Terminal-Bench AccuracyReported Launch postAutoClaw Team (Z.ai)Self-reportedZ.aiRecord for GLM-5.3-Flash on Terminal-Bench 2.1 — Claude Code
Terminal-Bench 2.1 — Vals AI Terminus 2Effort: MaxConfiguration: Terminus-2 harness62.9%vals.ai for GLM-5.3-Flash (max) on Terminal-Bench 2.1 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-5.3-Flash on Terminal-Bench 2.1 — Vals AI Terminus 2
Terminal-Bench 4.0 — Claude CodeEffort: NoneConfiguration: Claude Code harness35.8%tbench.ai for GLM-5.3-Flash (none) on Terminal-Bench 4.0 — Claude Code (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardTerminal-BenchIndependentTerminal-Bench TeamRecord for GLM-5.3-Flash on Terminal-Bench 4.0 — Claude Code
Terminal-Bench 4.0 — Mercor mini-swe-agentEffort: MaxConfiguration: Mercor mini-swe-agent, 1000 steps, 8 hours29.8%mercor.com for GLM-5.3-Flash (max) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for GLM-5.3-Flash on Terminal-Bench 4.0 — Mercor mini-swe-agent
Toolathlon VerifiedEffort: Max78.4%autoclaw.z.ai for GLM-5.3-Flash (max) on Toolathlon Verified (opens in a new tab)Tasks completedReported Launch postAutoClaw Team (Z.ai)Self-reportedZ.aiRecord for GLM-5.3-Flash on Toolathlon Verified
Vibe Code Bench 1.1 — OpenHands, October 2026 evaluationEffort: MaxConfiguration: OpenHands harness30.8%vals.ai for GLM-5.3-Flash (max) on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for GLM-5.3-Flash on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation