Benchmarks

5 results across 4 benchmarks

Benchmark results for GLM-4.5
BenchmarkScoreSource
GPQA Diamond — Vals AI harnessConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT72.2%vals.ai for GLM-4.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-4.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
Humanity's Last Exam Full set — Scale AI evaluation8.3%labs.scale.com for GLM-4.5 on Humanity's Last Exam Full set — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for GLM-4.5 on Humanity's Last Exam Full set — Scale AI evaluation
Humanity's Last Exam Text only — Scale AI evaluation9.6%labs.scale.com for GLM-4.5 on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for GLM-4.5 on Humanity's Last Exam Text only — Scale AI evaluation
MMLU-Pro Original — Vals AI harnessConfiguration: Vals AI harness81.2%vals.ai for GLM-4.5 on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-4.5 on MMLU-Pro Original — Vals AI harness
SWE-bench Verified — mini-swe-agentConfiguration: mini-swe-agent harness54.2%github.com for GLM-4.5 on SWE-bench Verified — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark repositorySWE-benchIndependentSWE-bench TeamRecord for GLM-4.5 on SWE-bench Verified — mini-swe-agent