Results

27 results

Terminal-Bench 4.0 — Vals AI mini-swe-agent results
ProviderModelScoreSourceRegistry No.
OpenAIGPT-6 Astra (max)59.6%vals.ai for GPT-6 Astra (max) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-6 Astra on Terminal-Bench 4.0 — Vals AI mini-swe-agent10005
OpenAIGPT-5.6 Luna (max)11.6%vals.ai for GPT-5.6 Luna (max) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.6 Luna on Terminal-Bench 4.0 — Vals AI mini-swe-agent10009
OpenAIGPT-5.6 Sol (max)37.9%vals.ai for GPT-5.6 Sol (max) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.6 Sol on Terminal-Bench 4.0 — Vals AI mini-swe-agent10010
OpenAIGPT-5.6 Terra (max)22.7%vals.ai for GPT-5.6 Terra (max) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.6 Terra on Terminal-Bench 4.0 — Vals AI mini-swe-agent10011
OpenAIGPT-6 Luna (max)13.6%vals.ai for GPT-6 Luna (max) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-6 Luna on Terminal-Bench 4.0 — Vals AI mini-swe-agent10013
OpenAIGPT-6 Sol (max)44.4%vals.ai for GPT-6 Sol (max) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-6 Sol on Terminal-Bench 4.0 — Vals AI mini-swe-agent10014
OpenAIGPT-6.1 Sol (max)55.1%vals.ai for GPT-6.1 Sol (max) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-6.1 Sol on Terminal-Bench 4.0 — Vals AI mini-swe-agent10015
OpenAIGPT-5.4 mini (xhigh)2.5%vals.ai for GPT-5.4 mini (xhigh) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.4 mini on Terminal-Bench 4.0 — Vals AI mini-swe-agent10021
DeepSeek AIDeepSeek-V4-Pro (max)11.1%vals.ai for DeepSeek-V4-Pro (max) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for DeepSeek-V4-Pro on Terminal-Bench 4.0 — Vals AI mini-swe-agent110002
Moonshot AIKimi K3 (max)17.2%vals.ai for Kimi K3 (max) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Kimi K3 on Terminal-Bench 4.0 — Vals AI mini-swe-agent120003
Alibaba (Tongyi)Qwen3.8-Max34.3%vals.ai for Qwen3.8-Max on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Qwen3.8-Max on Terminal-Bench 4.0 — Vals AI mini-swe-agent130008
MiniMaxMiniMax M31.0%vals.ai for MiniMax M3 on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for MiniMax M3 on Terminal-Bench 4.0 — Vals AI mini-swe-agent140003
Z.aiGLM-5.3 (max)38.9%vals.ai for GLM-5.3 (max) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GLM-5.3 on Terminal-Bench 4.0 — Vals AI mini-swe-agent150005
Thinking Machines LabInkling (0.99)0.5%vals.ai for Inkling (0.99) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Inkling on Terminal-Bench 4.0 — Vals AI mini-swe-agent160001
Thinking Machines LabInkling-Small (0.99)0.0%vals.ai for Inkling-Small (0.99) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Inkling-Small on Terminal-Bench 4.0 — Vals AI mini-swe-agent160002
AnthropicClaude Opus 4.823.2%vals.ai for Claude Opus 4.8 on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Opus 4.8 on Terminal-Bench 4.0 — Vals AI mini-swe-agent20011
AnthropicClaude Sonnet 59.6%vals.ai for Claude Sonnet 5 on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Claude Sonnet 5 on Terminal-Bench 4.0 — Vals AI mini-swe-agent20013
Google (DeepMind)Gemini 3.8 Flash (high)19.2%vals.ai for Gemini 3.8 Flash (high) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Gemini 3.8 Flash on Terminal-Bench 4.0 — Vals AI mini-swe-agent30004
Google (DeepMind)Gemini 3.1 Pro (high)2.5%vals.ai for Gemini 3.1 Pro (high) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Gemini 3.1 Pro on Terminal-Bench 4.0 — Vals AI mini-swe-agent30005
Google (DeepMind)Gemini 3.5 Flash (high)6.1%vals.ai for Gemini 3.5 Flash (high) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Gemini 3.5 Flash on Terminal-Bench 4.0 — Vals AI mini-swe-agent30006
Google (DeepMind)Gemini 3.7 Flash (high)12.1%vals.ai for Gemini 3.7 Flash (high) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Gemini 3.7 Flash on Terminal-Bench 4.0 — Vals AI mini-swe-agent30010
Google (DeepMind)Gemini 4 Argon (high)57.6%vals.ai for Gemini 4 Argon (high) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Gemini 4 Argon on Terminal-Bench 4.0 — Vals AI mini-swe-agent30011
SpaceXAIGrok 4.5 (high)8.6%vals.ai for Grok 4.5 (high) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Grok 4.5 on Terminal-Bench 4.0 — Vals AI mini-swe-agent40001
SpaceXAIGrok 4.6 (high)17.2%vals.ai for Grok 4.6 (high) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Grok 4.6 on Terminal-Bench 4.0 — Vals AI mini-swe-agent40002
SpaceXAIGrok 4.7 (xhigh)28.8%vals.ai for Grok 4.7 (xhigh) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Grok 4.7 on Terminal-Bench 4.0 — Vals AI mini-swe-agent40003
Meta AI (originally Facebook AI Research)Muse Spark 1.2 (xhigh)6.1%vals.ai for Muse Spark 1.2 (xhigh) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Muse Spark 1.2 on Terminal-Bench 4.0 — Vals AI mini-swe-agent80003
Meta AI (originally Facebook AI Research)Muse Spark 1.3 (xhigh)10.6%vals.ai for Muse Spark 1.3 (xhigh) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Muse Spark 1.3 on Terminal-Bench 4.0 — Vals AI mini-swe-agent80005