Terminal-Bench
Updated
Cite
Fill in the access date before citing.
Plain text
Benchmark Registry. Terminal-Bench 2.1 — Thinking Machines internal coding harness benchmark results. Benchmark identifier: terminal-bench/2-1-thinking-machines-internal. https://benchmarkregistry.org/benchmarks/terminal-bench/2-1-thinking-machines-internal. Accessed [YYYY-MM-DD]. Data license: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Attribution: Benchmark Registry, a project of Densa Labs — https://benchmarkregistry.org/ (CC BY 4.0). Include the cited record URL and identify any changes.
BibTeX
@misc{br_terminal_bench_2_1_thinking_machines_internal,
title = {Terminal-Bench 2.1 — Thinking Machines internal coding harness benchmark results},
publisher = {Benchmark Registry},
url = {https://benchmarkregistry.org/benchmarks/terminal-bench/2-1-thinking-machines-internal},
urldate = {YYYY-MM-DD},
note = {Benchmark identifier: terminal-bench/2-1-thinking-machines-internal; data license: CC BY 4.0; access date to be filled by the reader}
}Results
2 results
| Provider | Model | Score | Source | Registry No. |
|---|---|---|---|---|
| Thinking Machines Lab | Inkling-Small (effort=0.99) | 64.7% | thinkingmachines.ai for Inkling-Small (effort=0.99) on Terminal-Bench 2.1 — Thinking Machines internal coding harness (opens in a new tab)Terminal-Bench AccuracyReported Launch postThinking Machines LabSelf-reportedRecord for Inkling-Small on Terminal-Bench 2.1 — Thinking Machines internal coding harness | 160002 |
| Thinking Machines Lab | Inkling (effort=0.99) | 63.8% | thinkingmachines.ai for Inkling (effort=0.99) on Terminal-Bench 2.1 — Thinking Machines internal coding harness (opens in a new tab)Terminal-Bench AccuracyReported Launch postThinking Machines LabSelf-reportedRecord for Inkling on Terminal-Bench 2.1 — Thinking Machines internal coding harness | 160001 |