Benchmarks

119 results

Benchmark results for Moonshot AI
ModelBenchmarkScoreSourceRegistry No.
Kimi K2.5 (Thinking on)Chartography October 2026 leaderboard12.6%surgehq.ai for Kimi K2.5 (Thinking on) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Kimi K2.5 on Chartography October 2026 leaderboard120001
Kimi K2.5SWE Atlas Refactoring — mini-swe-agent21.0%labs.scale.com for Kimi K2.5 on SWE Atlas Refactoring — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Kimi K2.5 on SWE Atlas Refactoring — mini-swe-agent120001
Kimi K2.5SWE Atlas Codebase QnA — Public; mini-swe-agent13.1%labs.scale.com for Kimi K2.5 on SWE Atlas Codebase QnA — Public; mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Kimi K2.5 on SWE Atlas Codebase QnA — Public; mini-swe-agent120001
Kimi K2.5GPQA Diamond — Epoch AI harness87.6%epoch.ai for Kimi K2.5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Kimi K2.5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness120001
Kimi K2.5SimpleQA Verified Original — Epoch AI harness34.3%epoch.ai for Kimi K2.5 on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Kimi K2.5 on SimpleQA Verified Original — Epoch AI harness120001
Kimi K2.5 (Thinking on)Riemann-bench October 2026 leaderboard12.0%surgehq.ai for Kimi K2.5 (Thinking on) on Riemann-bench October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Riemann-bench Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Kimi K2.5 on Riemann-bench October 2026 leaderboard120001
Kimi K2.5SWE-bench Verified — Epoch AI harness73.8%epoch.ai for Kimi K2.5 on SWE-bench Verified — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Kimi K2.5 on SWE-bench Verified — Epoch AI harness120001
Kimi K2.6AutomationBench 1.0.62.6%zapier.com for Kimi K2.6 on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Kimi K2.6 on AutomationBench 1.0.6120002
Kimi K2.6GPQA Diamond — Epoch AI harness90.8%epoch.ai for Kimi K2.6 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Kimi K2.6 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness120002
Kimi K2.6 (Thinking on)Riemann-bench October 2026 leaderboard7.2%surgehq.ai for Kimi K2.6 (Thinking on) on Riemann-bench October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Riemann-bench Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Kimi K2.6 on Riemann-bench October 2026 leaderboard120002
Kimi K2.6SimpleQA Verified Original — Epoch AI harness34.9%epoch.ai for Kimi K2.6 on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Kimi K2.6 on SimpleQA Verified Original — Epoch AI harness120002
Kimi K2.6SWE-bench Verified — Epoch AI harness76.7%epoch.ai for Kimi K2.6 on SWE-bench Verified — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Kimi K2.6 on SWE-bench Verified — Epoch AI harness120002
Kimi K2.6 (Thinking on)Chartography October 2026 leaderboard12.2%surgehq.ai for Kimi K2.6 (Thinking on) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Kimi K2.6 on Chartography October 2026 leaderboard120002
Kimi K3 (max)CharXiv Descriptive and reasoning — Mercor single-shot93.9%mercor.com for Kimi K3 (max) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)CharXiv AccuracyReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on CharXiv Descriptive and reasoning — Mercor single-shot120003
Kimi K3 (max)MMMU-Pro 1,730 questions — Mercor single-shot80.7%mercor.com for Kimi K3 (max) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on MMMU-Pro 1,730 questions — Mercor single-shot120003
Kimi K3 (max)DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps66.4%mercor.com for Kimi K3 (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps120003
Kimi K3 (Max)Riemann-bench October 2026 leaderboard37.6%surgehq.ai for Kimi K3 (Max) on Riemann-bench October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Riemann-bench Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Kimi K3 on Riemann-bench October 2026 leaderboard120003
Kimi K3 (max)Terminal-Bench 4.0 — Mercor mini-swe-agent26.3%mercor.com for Kimi K3 (max) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on Terminal-Bench 4.0 — Mercor mini-swe-agent120003
Kimi K3AutomationBench 1.0.622.7%zapier.com for Kimi K3 on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Kimi K3 on AutomationBench 1.0.6120003
Kimi K3 (Max)Chartography October 2026 leaderboard26.6%surgehq.ai for Kimi K3 (Max) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Kimi K3 on Chartography October 2026 leaderboard120003
Kimi K3FrontierSWE 2 — October 2026 evaluation25.9%frontierswe.com for Kimi K3 on FrontierSWE 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)FrontierSWE ScoreReported Benchmark leaderboardProximalIndependentRecord for Kimi K3 on FrontierSWE 2 — October 2026 evaluation120003
Kimi K3 (max)MedXpertQA MM — Mercor single-shot73.2%mercor.com for Kimi K3 (max) on MedXpertQA MM — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on MedXpertQA MM — Mercor single-shot120003
Kimi K3 (max)SWE-bench Verified — Mercor mini-swe-agent, 1000 steps83.3%mercor.com for Kimi K3 (max) on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps120003
Kimi K3 (max)APEX-Agents Original50.6%mercor.com for Kimi K3 (max) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on APEX-Agents Original120003
Kimi K3 (max)SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps91.4%mercor.com for Kimi K3 (max) on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps120003
Kimi K3 (high)GPQA Diamond — Epoch AI harness91.9%epoch.ai for Kimi K3 (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Kimi K3 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness120003
Kimi K3 (max)Terminal-Bench 2.1 — Mercor Terminus 282.0%mercor.com for Kimi K3 (max) on Terminal-Bench 2.1 — Mercor Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on Terminal-Bench 2.1 — Mercor Terminus 2120003
Kimi K3 (max)GPQA Diamond — Epoch AI harness93.1%epoch.ai for Kimi K3 (max) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Kimi K3 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness120003
Kimi K3 (max)BrowseComp 130-question subset — Mercor web research agent89.0%mercor.com for Kimi K3 (max) on BrowseComp 130-question subset — Mercor web research agent (opens in a new tab)Archived copy (opens in a new tab)BrowseComp AccuracyReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on BrowseComp 130-question subset — Mercor web research agent120003
Kimi K3 (max)SimpleQA Verified Original — Epoch AI harness50.6%epoch.ai for Kimi K3 (max) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Kimi K3 on SimpleQA Verified Original — Epoch AI harness120003
Kimi K3 (low)GPQA Diamond — Epoch AI harness84.8%epoch.ai for Kimi K3 (low) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Kimi K3 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness120003
Kimi K3 (max)GPQA Diamond — Mercor single-shot92.7%mercor.com for Kimi K3 (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot120003
Kimi K3 (max)MMLU-Pro Original — Mercor single-shot89.3%mercor.com for Kimi K3 (max) on MMLU-Pro Original — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on MMLU-Pro Original — Mercor single-shot120003
Kimi K3 (max)Humanity's Last Exam Text only — Mercor single-shot46.5%mercor.com for Kimi K3 (max) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on Humanity's Last Exam Text only — Mercor single-shot120003
Kimi K3 (max)SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps52.7%mercor.com for Kimi K3 (max) on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps120003
Kimi K2.5 (thinking)Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation17.5%vals.ai for Kimi K2.5 (thinking) on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for Kimi K2.5 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation120001
Kimi K2.5 (thinking)Finance Agent Benchmark 2 — October 2026 evaluation35.8%vals.ai for Kimi K2.5 (thinking) on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Finance Agent AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Kimi K2.5 on Finance Agent Benchmark 2 — October 2026 evaluation120001
Kimi K2.5 (thinking)HLAB October 2026 evaluation0.0%vals.ai for Kimi K2.5 (thinking) on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)HLAB Task Pass RateReported Benchmark leaderboardVals AIIndependentRecord for Kimi K2.5 on Harvey's Legal Agent Benchmark October 2026 evaluation120001
Kimi K2.6Finance Agent Benchmark 2 — October 2026 evaluation44.9%vals.ai for Kimi K2.6 on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Finance Agent AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Kimi K2.6 on Finance Agent Benchmark 2 — October 2026 evaluation120002
Kimi K2.6Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation37.9%vals.ai for Kimi K2.6 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for Kimi K2.6 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation120002
Kimi K2.6HLAB October 2026 evaluation1.7%vals.ai for Kimi K2.6 on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)HLAB Task Pass RateReported Benchmark leaderboardVals AIIndependentRecord for Kimi K2.6 on Harvey's Legal Agent Benchmark October 2026 evaluation120002
Kimi K3 (max)Terminal-Bench 4.0 — Vals AI mini-swe-agent17.2%vals.ai for Kimi K3 (max) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Kimi K3 on Terminal-Bench 4.0 — Vals AI mini-swe-agent120003
Kimi K3 (max)Vals Index 2.150.3%vals.ai for Kimi K3 (max) on Vals Index 2.1 (opens in a new tab)Archived copy (opens in a new tab)Vals Index GDP-weighted AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Kimi K3 on Vals Index 2.1120003
Kimi K3 (max)HLAB October 2026 evaluation12.9%vals.ai for Kimi K3 (max) on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)HLAB Task Pass RateReported Benchmark leaderboardVals AIIndependentRecord for Kimi K3 on Harvey's Legal Agent Benchmark October 2026 evaluation120003
Kimi K3 (max)Finance Agent Benchmark 2 — October 2026 evaluation53.1%vals.ai for Kimi K3 (max) on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Finance Agent AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Kimi K3 on Finance Agent Benchmark 2 — October 2026 evaluation120003
Kimi K3 (max)Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation85.0%vals.ai for Kimi K3 (max) on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for Kimi K3 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation120003
Kimi K3PostTrainBench 1.2 — Claude Code31.5%posttrainbench.com for Kimi K3 on PostTrainBench 1.2 — Claude Code (opens in a new tab)Archived copy (opens in a new tab)PostTrainBench Weighted AggregateReported Benchmark leaderboardPostTrainBenchIndependentPostTrainBench TeamRecord for Kimi K3 on PostTrainBench 1.2 — Claude Code120003
Kimi K3PostTrainBench 1.1 — Claude Code32.0%posttrainbench.com for Kimi K3 on PostTrainBench 1.1 — Claude Code (opens in a new tab)Archived copy (opens in a new tab)PostTrainBench Weighted AggregateReported Benchmark leaderboardPostTrainBenchIndependentPostTrainBench TeamRecord for Kimi K3 on PostTrainBench 1.1 — Claude Code120003
Kimi K2.5Humanity's Last Exam Full set — Scale AI evaluation24.4%labs.scale.com for Kimi K2.5 on Humanity's Last Exam Full set — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Kimi K2.5 on Humanity's Last Exam Full set — Scale AI evaluation120001
Kimi K2.5 (thinking)Terminal-Bench 2.1 — Vals AI Terminus 241.9%vals.ai for Kimi K2.5 (thinking) on Terminal-Bench 2.1 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Kimi K2.5 on Terminal-Bench 2.1 — Vals AI Terminus 2120001