Benchmarks

7 results across 7 benchmarks

Benchmark results for GLM-4.6
BenchmarkScoreSource
GPQA Diamond — Vals AI harnessConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT74.5%vals.ai for GLM-4.6 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-4.6 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
MMLU-Pro Original — Vals AI harnessConfiguration: Vals AI harness82.2%vals.ai for GLM-4.6 on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-4.6 on MMLU-Pro Original — Vals AI harness
SWE-bench Verified — mini-swe-agentConfiguration: mini-swe-agent harness55.4%github.com for GLM-4.6 on SWE-bench Verified — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark repositorySWE-benchIndependentSWE-bench TeamRecord for GLM-4.6 on SWE-bench Verified — mini-swe-agent
SWE-bench Pro Public — Scale AI SWE-AgentConfiguration: SWE-Agent harness, 250 turns, uncapped cost9.7%labs.scale.com for GLM-4.6 on SWE-bench Pro Public — Scale AI SWE-Agent (opens in a new tab)Archived copy (opens in a new tab)Public tasks resolvedReported Benchmark leaderboardScale AIIndependentRecord for GLM-4.6 on SWE-bench Pro Public — Scale AI SWE-Agent
Terminal-Bench 2.0 — Vals AI Terminus 2Configuration: Terminus-2 harness28.1%vals.ai for GLM-4.6 on Terminal-Bench 2.0 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-4.6 on Terminal-Bench 2.0 — Vals AI Terminus 2
Toolathlon Original18.8%toolathlon.xyz for GLM-4.6 on Toolathlon Original (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for GLM-4.6 on Toolathlon Original
Vibe Code Bench 1.1 — OpenHands, October 2026 evaluationConfiguration: OpenHands harness3.1%vals.ai for GLM-4.6 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for GLM-4.6 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation