Results

19 results

Terminal-Bench 4.0 — Mercor mini-swe-agent results
ProviderModelScoreSourceRegistry No.
OpenAIGPT-6 Astra (max)54.5%mercor.com for GPT-6 Astra (max) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-6 Astra on Terminal-Bench 4.0 — Mercor mini-swe-agent10005
OpenAIGPT-5.6 Luna (max)10.1%mercor.com for GPT-5.6 Luna (max) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-5.6 Luna on Terminal-Bench 4.0 — Mercor mini-swe-agent10009
OpenAIGPT-5.6 Terra (max)24.7%mercor.com for GPT-5.6 Terra (max) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-5.6 Terra on Terminal-Bench 4.0 — Mercor mini-swe-agent10011
OpenAIGPT-6 Luna (max)13.5%mercor.com for GPT-6 Luna (max) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-6 Luna on Terminal-Bench 4.0 — Mercor mini-swe-agent10013
OpenAIGPT-6 Sol (max)43.8%mercor.com for GPT-6 Sol (max) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-6 Sol on Terminal-Bench 4.0 — Mercor mini-swe-agent10014
OpenAIGPT-6.1 Sol (max)59.6%mercor.com for GPT-6.1 Sol (max) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-6.1 Sol on Terminal-Bench 4.0 — Mercor mini-swe-agent10015
Moonshot AIKimi K3 (max)26.3%mercor.com for Kimi K3 (max) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on Terminal-Bench 4.0 — Mercor mini-swe-agent120003
MiniMaxMiniMax M3 (high)1.0%mercor.com for MiniMax M3 (high) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for MiniMax M3 on Terminal-Bench 4.0 — Mercor mini-swe-agent140003
Z.aiGLM-5.3 (max)37.9%mercor.com for GLM-5.3 (max) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for GLM-5.3 on Terminal-Bench 4.0 — Mercor mini-swe-agent150005
Z.aiGLM-5.3-Flash (max)29.8%mercor.com for GLM-5.3-Flash (max) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for GLM-5.3-Flash on Terminal-Bench 4.0 — Mercor mini-swe-agent150006
Thinking Machines LabInkling (high)0.5%mercor.com for Inkling (high) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for Inkling on Terminal-Bench 4.0 — Mercor mini-swe-agent160001
AnthropicClaude Fable 5.1 (max)53.0%mercor.com for Claude Fable 5.1 (max) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Fable 5.1 on Terminal-Bench 4.0 — Mercor mini-swe-agent20004
AnthropicClaude Opus 5 (max)49.5%mercor.com for Claude Opus 5 (max) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Opus 5 on Terminal-Bench 4.0 — Mercor mini-swe-agent20014
AnthropicClaude Opus 5.5 (max)58.3%mercor.com for Claude Opus 5.5 (max) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Opus 5.5 on Terminal-Bench 4.0 — Mercor mini-swe-agent20015
AnthropicClaude Sonnet 5.5 (max)51.5%mercor.com for Claude Sonnet 5.5 (max) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for Claude Sonnet 5.5 on Terminal-Bench 4.0 — Mercor mini-swe-agent20016
Google (DeepMind)Gemini 3.8 Flash (high)12.1%mercor.com for Gemini 3.8 Flash (high) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for Gemini 3.8 Flash on Terminal-Bench 4.0 — Mercor mini-swe-agent30004
SpaceXAIGrok 4.6 (xhigh)25.3%mercor.com for Grok 4.6 (xhigh) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.6 on Terminal-Bench 4.0 — Mercor mini-swe-agent40002
SpaceXAIGrok 4.7 (xhigh)6.6%mercor.com for Grok 4.7 (xhigh) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for Grok 4.7 on Terminal-Bench 4.0 — Mercor mini-swe-agent40003
NVIDIANVIDIA Nemotron 3 Ultra 550B-A55B (high)0.0%mercor.com for NVIDIA Nemotron 3 Ultra 550B-A55B (high) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for NVIDIA Nemotron 3 Ultra 550B-A55B on Terminal-Bench 4.0 — Mercor mini-swe-agent60003