| Inkling (high) | Humanity's Last Exam Text only — Mercor single-shot | 25.5% | mercor.com for Inkling (high) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for Inkling on Humanity's Last Exam Text only — Mercor single-shot | 160001 |
| Inkling (high) | Terminal-Bench 4.0 — Mercor mini-swe-agent | 0.5% | mercor.com for Inkling (high) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for Inkling on Terminal-Bench 4.0 — Mercor mini-swe-agent | 160001 |
| Inkling (high) | BrowseComp 130-question subset — Mercor web research agent | 50.4% | mercor.com for Inkling (high) on BrowseComp 130-question subset — Mercor web research agent (opens in a new tab)Archived copy (opens in a new tab)BrowseComp AccuracyReported Benchmark leaderboardMercorIndependentRecord for Inkling on BrowseComp 130-question subset — Mercor web research agent | 160001 |
| Inkling (high) | MMMU-Pro 1,730 questions — Mercor single-shot | 69.7% | mercor.com for Inkling (high) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Benchmark leaderboardMercorIndependentRecord for Inkling on MMMU-Pro 1,730 questions — Mercor single-shot | 160001 |
| Inkling (high) | CharXiv Descriptive and reasoning — Mercor single-shot | 88.9% | mercor.com for Inkling (high) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)CharXiv AccuracyReported Benchmark leaderboardMercorIndependentRecord for Inkling on CharXiv Descriptive and reasoning — Mercor single-shot | 160001 |
| Inkling (high) | DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps | 5.0% | mercor.com for Inkling (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for Inkling on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps | 160001 |
| Inkling (high) | MMLU-Pro Original — Mercor single-shot | 86.8% | mercor.com for Inkling (high) on MMLU-Pro Original — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Inkling on MMLU-Pro Original — Mercor single-shot | 160001 |
| Inkling (xHigh) | Riemann-bench October 2026 leaderboard | 15.2% | surgehq.ai for Inkling (xHigh) on Riemann-bench October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Riemann-bench Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Inkling on Riemann-bench October 2026 leaderboard | 160001 |
| Inkling (high) | SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps | 77.7% | mercor.com for Inkling (high) on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Inkling on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps | 160001 |
| Inkling (high) | GPQA Diamond — Mercor single-shot | 87.2% | mercor.com for Inkling (high) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Inkling on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot | 160001 |
| Inkling (High) | Chartography October 2026 leaderboard | 10.0% | surgehq.ai for Inkling (High) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Inkling on Chartography October 2026 leaderboard | 160001 |
| Inkling (high) | MedXpertQA MM — Mercor single-shot | 60.0% | mercor.com for Inkling (high) on MedXpertQA MM — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Inkling on MedXpertQA MM — Mercor single-shot | 160001 |
| Inkling (high) | SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps | 21.2% | mercor.com for Inkling (high) on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardMercorIndependentRecord for Inkling on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps | 160001 |
| Inkling | FrontierSWE 2 — October 2026 evaluation | 4.1% | frontierswe.com for Inkling on FrontierSWE 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)FrontierSWE ScoreReported Benchmark leaderboardProximalIndependentRecord for Inkling on FrontierSWE 2 — October 2026 evaluation | 160001 |
| Inkling (xhigh) | SimpleQA Verified Original — Epoch AI harness | 40.3% | epoch.ai for Inkling (xhigh) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Inkling on SimpleQA Verified Original — Epoch AI harness | 160001 |
| Inkling (xhigh) | GPQA Diamond — Epoch AI harness | 88.3% | epoch.ai for Inkling (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Inkling on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness | 160001 |
| Inkling (high) | CWE-bench 1 — OpenCode | 37.0% | cwe-bench.com for Inkling (high) on CWE-bench 1 — OpenCode (opens in a new tab)Archived copy (opens in a new tab)CWE-bench Programmatic Pass@1Reported Benchmark leaderboardCollinear AIIndependentRecord for Inkling on CWE-bench 1 — OpenCode | 160001 |
| Inkling (high) | APEX-Agents Original | 33.8% | mercor.com for Inkling (high) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for Inkling on APEX-Agents Original | 160001 |
| Inkling-Small (xHigh) | Chartography October 2026 leaderboard | 9.1% | surgehq.ai for Inkling-Small (xHigh) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Inkling-Small on Chartography October 2026 leaderboard | 160002 |
| Inkling-Small (xhigh) | SimpleQA Verified Original — Epoch AI harness | 19.1% | epoch.ai for Inkling-Small (xhigh) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Inkling-Small on SimpleQA Verified Original — Epoch AI harness | 160002 |
| Inkling-Small (xhigh) | GPQA Diamond — Epoch AI harness | 88.5% | epoch.ai for Inkling-Small (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Inkling-Small on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness | 160002 |
| Inkling (0.99) | Finance Agent Benchmark 2 — October 2026 evaluation | 46.6% | vals.ai for Inkling (0.99) on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Finance Agent AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Inkling on Finance Agent Benchmark 2 — October 2026 evaluation | 160001 |
| Inkling (0.99) | Vals Index 2.1 | 28.7% | vals.ai for Inkling (0.99) on Vals Index 2.1 (opens in a new tab)Archived copy (opens in a new tab)Vals Index GDP-weighted AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Inkling on Vals Index 2.1 | 160001 |
| Inkling (0.99) | HLAB October 2026 evaluation | 2.1% | vals.ai for Inkling (0.99) on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)HLAB Task Pass RateReported Benchmark leaderboardVals AIIndependentRecord for Inkling on Harvey's Legal Agent Benchmark October 2026 evaluation | 160001 |
| Inkling (0.99) | Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation | 19.2% | vals.ai for Inkling (0.99) on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for Inkling on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation | 160001 |
| Inkling (0.99) | Terminal-Bench 4.0 — Vals AI mini-swe-agent | 0.5% | vals.ai for Inkling (0.99) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Inkling on Terminal-Bench 4.0 — Vals AI mini-swe-agent | 160001 |
| Inkling-Small (0.99) | HLAB October 2026 evaluation | 1.7% | vals.ai for Inkling-Small (0.99) on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)HLAB Task Pass RateReported Benchmark leaderboardVals AIIndependentRecord for Inkling-Small on Harvey's Legal Agent Benchmark October 2026 evaluation | 160002 |
| Inkling-Small (0.99) | Vals Index 2.1 | 25.5% | vals.ai for Inkling-Small (0.99) on Vals Index 2.1 (opens in a new tab)Archived copy (opens in a new tab)Vals Index GDP-weighted AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Inkling-Small on Vals Index 2.1 | 160002 |
| Inkling-Small (0.99) | Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation | 19.1% | vals.ai for Inkling-Small (0.99) on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for Inkling-Small on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation | 160002 |
| Inkling-Small (0.99) | Finance Agent Benchmark 2 — October 2026 evaluation | 41.3% | vals.ai for Inkling-Small (0.99) on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Finance Agent AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Inkling-Small on Finance Agent Benchmark 2 — October 2026 evaluation | 160002 |
| Inkling-Small (0.99) | Terminal-Bench 4.0 — Vals AI mini-swe-agent | 0.0% | vals.ai for Inkling-Small (0.99) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Inkling-Small on Terminal-Bench 4.0 — Vals AI mini-swe-agent | 160002 |
| Inkling (0.99) | Terminal-Bench 2.1 — Vals AI Terminus 2 | 47.6% | vals.ai for Inkling (0.99) on Terminal-Bench 2.1 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Inkling on Terminal-Bench 2.1 — Vals AI Terminus 2 | 160001 |
| Inkling-Small (0.99) | Terminal-Bench 2.1 — Vals AI Terminus 2 | 55.1% | vals.ai for Inkling-Small (0.99) on Terminal-Bench 2.1 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Inkling-Small on Terminal-Bench 2.1 — Vals AI Terminus 2 | 160002 |
| Inkling (xHigh) | MCP Atlas Public, April 2026 update | 76.0% | labs.scale.com for Inkling (xHigh) on MCP Atlas Public, April 2026 update (opens in a new tab)Pass rateReported Benchmark leaderboardScale AIIndependentRecord for Inkling on MCP Atlas Public, April 2026 update | 160001 |
| Inkling-Small | MCP Atlas Public, April 2026 update | 79.2% | labs.scale.com for Inkling-Small on MCP Atlas Public, April 2026 update (opens in a new tab)Pass rateReported Benchmark leaderboardScale AIIndependentRecord for Inkling-Small on MCP Atlas Public, April 2026 update | 160002 |
| Inkling (0.99) | GPQA Diamond — Vals AI harness | 87.1% | vals.ai for Inkling (0.99) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Inkling on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness | 160001 |
| Inkling (0.99) | MMLU-Pro Original — Vals AI harness | 86.3% | vals.ai for Inkling (0.99) on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Inkling on MMLU-Pro Original — Vals AI harness | 160001 |
| Inkling (0.99) | SWE-bench Verified — Vals AI mini-swe-agent | 77.6% | vals.ai for Inkling (0.99) on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardVals AIIndependentRecord for Inkling on SWE-bench Verified — Vals AI mini-swe-agent | 160001 |
| Inkling (0.99) | MMMU-Pro Vals AI harness | 78.5% | vals.ai for Inkling (0.99) on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for Inkling on MMMU-Pro Vals AI harness | 160001 |
| Inkling-Small (0.99) | SWE-bench Verified — Vals AI mini-swe-agent | 82.2% | vals.ai for Inkling-Small (0.99) on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardVals AIIndependentRecord for Inkling-Small on SWE-bench Verified — Vals AI mini-swe-agent | 160002 |
| Inkling-Small (0.99) | MMLU-Pro Original — Vals AI harness | 85.6% | vals.ai for Inkling-Small (0.99) on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Inkling-Small on MMLU-Pro Original — Vals AI harness | 160002 |
| Inkling-Small (0.99) | GPQA Diamond — Vals AI harness | 83.6% | vals.ai for Inkling-Small (0.99) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Inkling-Small on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness | 160002 |
| Inkling (max) | τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading | 25.0% | sierra-tau-bench-public.s3.us-west-2.amazonaws.com for Inkling (max) on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading (opens in a new tab)Archived copy (opens in a new tab)Task success rateReported Evaluated Benchmark leaderboardSierraIndependentSierra ResearchRecord for Inkling on τ³-bench τ³ — Banking, AllTools retrieval, v1.0.1 grading | 160001 |
| Inkling-Small (effort=0.99) | SWE-bench Verified — bash-only harness | 80.2% | thinkingmachines.ai for Inkling-Small (effort=0.99) on SWE-bench Verified — bash-only harness (opens in a new tab)Resolved TasksReported Launch postThinking Machines LabSelf-reportedRecord for Inkling-Small on SWE-bench Verified — bash-only harness | 160002 |
| Inkling-Small (effort=0.99) | Terminal-Bench 2.1 — Thinking Machines internal coding harness | 64.7% | thinkingmachines.ai for Inkling-Small (effort=0.99) on Terminal-Bench 2.1 — Thinking Machines internal coding harness (opens in a new tab)Terminal-Bench AccuracyReported Launch postThinking Machines LabSelf-reportedRecord for Inkling-Small on Terminal-Bench 2.1 — Thinking Machines internal coding harness | 160002 |
| Inkling-Small (effort=0.99) | CharXiv Reasoning — Python enabled | 81.3% | thinkingmachines.ai for Inkling-Small (effort=0.99) on CharXiv Reasoning — Python enabled (opens in a new tab)CharXiv AccuracyReported Model cardThinking Machines LabSelf-reportedRecord for Inkling-Small on CharXiv Reasoning — Python enabled | 160002 |
| Inkling-Small (effort=0.99) | SWE-bench Pro Public | 55.9% | thinkingmachines.ai for Inkling-Small (effort=0.99) on SWE-bench Pro Public (opens in a new tab)Public tasks resolvedReported Launch postThinking Machines LabSelf-reportedRecord for Inkling-Small on SWE-bench Pro Public | 160002 |
| Inkling-Small (effort=0.99) | IFBench Original | 82.2% | thinkingmachines.ai for Inkling-Small (effort=0.99) on IFBench Original (opens in a new tab)AccuracyReported Launch postThinking Machines LabSelf-reportedRecord for Inkling-Small on IFBench Original | 160002 |
| Inkling-Small (effort=0.99) | BrowseComp With context management — Inkling evaluation | 77.4% | thinkingmachines.ai for Inkling-Small (effort=0.99) on BrowseComp With context management — Inkling evaluation (opens in a new tab)BrowseComp AccuracyReported Launch postThinking Machines LabSelf-reportedRecord for Inkling-Small on BrowseComp With context management — Inkling evaluation | 160002 |
| Inkling-Small (effort=0.99) | StrongREJECT Original | 98.4% | thinkingmachines.ai for Inkling-Small (effort=0.99) on StrongREJECT Original (opens in a new tab)Harmful-request refusal rateReported Launch postThinking Machines LabSelf-reportedRecord for Inkling-Small on StrongREJECT Original | 160002 |