Name: NL2Repo Bench
Creator: Benchmark Registry

Versions of NL2Repo Bench
Version	Released	Models	Results
NL2Repo Bench OriginalLatest	December 14, 2025	5	5

Recently reported results for NL2Repo Bench Original
Model	Score	Source
GLM-5.3-Flash (max)	56.3%	autoclaw.z.ai for GLM-5.3-Flash (max) on NL2Repo Bench Original (opens in a new tab)Average test pass rateReported September 24, 2026Launch postAutoClaw Team (Z.ai)Self-reportedZ.aiRecord for GLM-5.3-Flash on NL2Repo Bench Original
GLM-5.3 (max)	58.0%	z.ai for GLM-5.3 (max) on NL2Repo Bench Original (opens in a new tab)Average test pass rateReported August 14, 2026Launch postZ.aiSelf-reportedRecord for GLM-5.3 on NL2Repo Bench Original
GLM-5.2	48.9%	z.ai for GLM-5.2 on NL2Repo Bench Original (opens in a new tab)Average test pass rateReported June 16, 2026Launch postZ.aiSelf-reportedRecord for GLM-5.2 on NL2Repo Bench Original
Qwen3.6-35B-A3B	29.4%	huggingface.co for Qwen3.6-35B-A3B on NL2Repo Bench Original (opens in a new tab)Average test pass rateReported April 17, 2026Model cardQwenSelf-reportedQwen TeamRecord for Qwen3.6-35B-A3B on NL2Repo Bench Original
GLM-5.1	42.7%	z.ai for GLM-5.1 on NL2Repo Bench Original (opens in a new tab)Average test pass rateReported April 7, 2026Launch postZ.aiSelf-reportedRecord for GLM-5.1 on NL2Repo Bench Original

Versions

Recently reported results: NL2Repo Bench Original