Terminal-Bench
Updated
Cite
Fill in the access date before citing.
Plain text
Benchmark Registry. Terminal-Bench 2.0 — GitHub Copilot production harness benchmark results. Benchmark identifier: terminal-bench/2-0-github-copilot. https://benchmarkregistry.org/benchmarks/terminal-bench/2-0-github-copilot. Accessed [YYYY-MM-DD]. Data license: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Attribution: Benchmark Registry, a project of Densa Labs — https://benchmarkregistry.org/ (CC BY 4.0). Include the cited record URL and identify any changes.
BibTeX
@misc{br_terminal_bench_2_0_github_copilot,
title = {Terminal-Bench 2.0 — GitHub Copilot production harness benchmark results},
publisher = {Benchmark Registry},
url = {https://benchmarkregistry.org/benchmarks/terminal-bench/2-0-github-copilot},
urldate = {YYYY-MM-DD},
note = {Benchmark identifier: terminal-bench/2-0-github-copilot; data license: CC BY 4.0; access date to be filled by the reader}
}Results
1 result
| Provider | Model | Score | Source | Registry No. |
|---|---|---|---|---|
| Microsoft AI | MAI-Code-1-Flash (adaptive thinking) | 54.8% | microsoft.ai for MAI-Code-1-Flash (adaptive thinking) on Terminal-Bench 2.0 — GitHub Copilot production harness (opens in a new tab)Terminal-Bench AccuracyReported Launch postMicrosoft AISelf-reportedMicrosoftRecord for MAI-Code-1-Flash on Terminal-Bench 2.0 — GitHub Copilot production harness | 70002 |