Shared benchmarks

3
Shared benchmarks for GLM-4.5 and GLM-4.6
BenchmarkGLM-4.5GLM-4.6
  • 72.2%
  • 74.5%
Evaluation details for GPQA Diamond — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GLM-4.5

Record for GLM-4.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness

GLM-4.6

Record for GLM-4.6 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
  • 81.2%
  • 82.2%
Evaluation details for MMLU-Pro Original — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GLM-4.5

Record for GLM-4.5 on MMLU-Pro Original — Vals AI harness

GLM-4.6

Record for GLM-4.6 on MMLU-Pro Original — Vals AI harness
  • 54.2%
  • 55.4%
Evaluation details for SWE-bench Verified — mini-swe-agent

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GLM-4.5

Record for GLM-4.5 on SWE-bench Verified — mini-swe-agent

GLM-4.6

Record for GLM-4.6 on SWE-bench Verified — mini-swe-agent