Shared benchmarks

4
Shared benchmarks for GLM-4.6 and GLM-4.7
BenchmarkGLM-4.6GLM-4.7
  • 74.5%
  • 80.1%
Evaluation details for GPQA Diamond — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GLM-4.6

Record for GLM-4.6 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness

GLM-4.7

Record for GLM-4.7 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
  • 82.2%
  • 82.7%
Evaluation details for MMLU-Pro Original — Vals AI harness

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GLM-4.6

Record for GLM-4.6 on MMLU-Pro Original — Vals AI harness

GLM-4.7

Record for GLM-4.7 on MMLU-Pro Original — Vals AI harness
  • 28.1%
  • 38.2%
Evaluation details for Terminal-Bench 2.0 — Vals AI Terminus 2

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GLM-4.6

Record for GLM-4.6 on Terminal-Bench 2.0 — Vals AI Terminus 2

GLM-4.7

Record for GLM-4.7 on Terminal-Bench 2.0 — Vals AI Terminus 2
  • 18.8%
  • 23.8%
Evaluation details for Toolathlon Original

The recorded benchmark version, metric, and evaluator sets match. Evaluation methodology is not recorded by the registry.

GLM-4.6

Record for GLM-4.6 on Toolathlon Original

GLM-4.7

Record for GLM-4.7 on Toolathlon Original