Benchmarks

52 results across 29 benchmarks

Benchmark results for Kimi K3
BenchmarkScoreSource
APEX-Agents OriginalEffort: Max50.6%mercor.com for Kimi K3 (max) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on APEX-Agents Original
AutomationBench 1.0.622.7%zapier.com for Kimi K3 on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for Kimi K3 on AutomationBench 1.0.6
BabyVision Original — Python enabledEffort: MaxConfiguration: With Python85.7%raw.githubusercontent.com for Kimi K3 (max) on BabyVision Original — Python enabled (opens in a new tab)AccuracyReported Technical reportMoonshot AISelf-reportedRecord for Kimi K3 on BabyVision Original — Python enabled
BrowseComp 130-question subset — Mercor web research agentEffort: MaxConfiguration: Mercor web research agent, 100 steps, 3 hours89.0%mercor.com for Kimi K3 (max) on BrowseComp 130-question subset — Mercor web research agent (opens in a new tab)Archived copy (opens in a new tab)BrowseComp AccuracyReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on BrowseComp 130-question subset — Mercor web research agent
BrowseCompEffort: Max91.2%huggingface.co for Kimi K3 (max) on BrowseComp BrowseComp (opens in a new tab)BrowseComp AccuracyReported Model cardMoonshot AISelf-reportedRecord for Kimi K3 on BrowseComp BrowseComp
Chartography October 2026 leaderboardEffort: Max26.6%surgehq.ai for Kimi K3 (Max) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Kimi K3 on Chartography October 2026 leaderboard
CharXiv Descriptive and reasoning — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent93.9%mercor.com for Kimi K3 (max) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)CharXiv AccuracyReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on CharXiv Descriptive and reasoning — Mercor single-shot
CharXiv Reasoning — No toolsEffort: MaxConfiguration: No tools84.8%huggingface.co for Kimi K3 (max) on CharXiv Reasoning — No tools (opens in a new tab)CharXiv AccuracyReported Model cardMoonshot AISelf-reportedRecord for Kimi K3 on CharXiv Reasoning — No tools
CharXiv Reasoning — Python enabledEffort: MaxConfiguration: With Python91.3%raw.githubusercontent.com for Kimi K3 (max) on CharXiv Reasoning — Python enabled (opens in a new tab)CharXiv AccuracyReported Technical reportMoonshot AISelf-reportedRecord for Kimi K3 on CharXiv Reasoning — Python enabled
DeepSWE 1.1Effort: Max69.0%deepswe.datacurve.ai for Kimi K3 (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for Kimi K3 on DeepSWE 1.1
DeepSWE 1.1 — Mercor mini-swe-agent, 500 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 500 steps, 2 hours66.4%mercor.com for Kimi K3 (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps
Finance Agent Benchmark 2 — October 2026 evaluationEffort: Max53.1%vals.ai for Kimi K3 (max) on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Finance Agent AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Kimi K3 on Finance Agent Benchmark 2 — October 2026 evaluation
FrontierSWE 2 — October 2026 evaluationConfiguration: Proximus harness, 5 trials, 20-hour budget25.9%frontierswe.com for Kimi K3 on FrontierSWE 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)FrontierSWE ScoreReported Benchmark leaderboardProximalIndependentRecord for Kimi K3 on FrontierSWE 2 — October 2026 evaluation
GPQA DiamondEffort: Max93.5%huggingface.co for Kimi K3 (max) on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Model cardMoonshot AISelf-reportedRecord for Kimi K3 on Graduate-Level Google-Proof Q&A Diamond
GPQA Diamond — Epoch AI harnessEffort: LowConfiguration: Epoch AI harness84.8%epoch.ai for Kimi K3 (low) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Kimi K3 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Epoch AI harnessEffort: HighConfiguration: Epoch AI harness91.9%epoch.ai for Kimi K3 (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Kimi K3 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Epoch AI harnessEffort: MaxConfiguration: Epoch AI harness93.1%epoch.ai for Kimi K3 (max) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Kimi K3 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent92.7%mercor.com for Kimi K3 (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot
GPQA Diamond — Vals AI harnessConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT92.9%vals.ai for Kimi K3 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Kimi K3 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
HLAB October 2026 evaluationEffort: Max12.9%vals.ai for Kimi K3 (max) on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)HLAB Task Pass RateReported Benchmark leaderboardVals AIIndependentRecord for Kimi K3 on Harvey's Legal Agent Benchmark October 2026 evaluation
Humanity's Last Exam Full set — No toolsEffort: MaxConfiguration: No tools43.5%huggingface.co for Kimi K3 (max) on Humanity's Last Exam Full set — No tools (opens in a new tab)Humanity's Last Exam AccuracyReported Model cardMoonshot AISelf-reportedRecord for Kimi K3 on Humanity's Last Exam Full set — No tools
Humanity's Last Exam Full set — With toolsEffort: MaxConfiguration: With tools56.0%huggingface.co for Kimi K3 (max) on Humanity's Last Exam Full set — With tools (opens in a new tab)Humanity's Last Exam AccuracyReported Model cardMoonshot AISelf-reportedRecord for Kimi K3 on Humanity's Last Exam Full set — With tools
Humanity's Last Exam Text only — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent46.5%mercor.com for Kimi K3 (max) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on Humanity's Last Exam Text only — Mercor single-shot
MATH-Vision OriginalEffort: Max94.3%raw.githubusercontent.com for Kimi K3 (max) on MATH-Vision Original (opens in a new tab)AccuracyReported Technical reportMoonshot AISelf-reportedRecord for Kimi K3 on MATH-Vision Original
MATH-Vision Original — Python enabledEffort: MaxConfiguration: With Python97.8%raw.githubusercontent.com for Kimi K3 (max) on MATH-Vision Original — Python enabled (opens in a new tab)AccuracyReported Technical reportMoonshot AISelf-reportedRecord for Kimi K3 on MATH-Vision Original — Python enabled
MCP Atlas Public, April 2026 updateEffort: Max82.3%labs.scale.com for Kimi K3 (max) on MCP Atlas Public, April 2026 update (opens in a new tab)Pass rateReported Benchmark leaderboardScale AIIndependentRecord for Kimi K3 on MCP Atlas Public, April 2026 update
MedXpertQA MM — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent73.2%mercor.com for Kimi K3 (max) on MedXpertQA MM — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on MedXpertQA MM — Mercor single-shot
MMLU-Pro Original — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent89.3%mercor.com for Kimi K3 (max) on MMLU-Pro Original — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on MMLU-Pro Original — Mercor single-shot
MMLU-Pro Original — Vals AI harnessEffort: MaxConfiguration: Vals AI harness88.0%vals.ai for Kimi K3 (max) on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Kimi K3 on MMLU-Pro Original — Vals AI harness
MMMU-Pro 1,730 questions — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent80.7%mercor.com for Kimi K3 (max) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on MMMU-Pro 1,730 questions — Mercor single-shot
MMMU-Pro No toolsEffort: MaxConfiguration: No tools81.6%huggingface.co for Kimi K3 (max) on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Model cardMoonshot AISelf-reportedRecord for Kimi K3 on MMMU-Pro No tools
MMMU-Pro Vals AI harnessConfiguration: Vals AI harness88.2%vals.ai for Kimi K3 on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for Kimi K3 on MMMU-Pro Vals AI harness
MMMU-Pro With toolsEffort: MaxConfiguration: With tools83.4%huggingface.co for Kimi K3 (max) on MMMU-Pro With tools (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Model cardMoonshot AISelf-reportedRecord for Kimi K3 on MMMU-Pro With tools
OSWorld VerifiedEffort: Max84.8%huggingface.co for Kimi K3 (max) on OSWorld Verified (opens in a new tab)OSWorld-Verified success rateReported Model cardMoonshot AISelf-reportedRecord for Kimi K3 on OSWorld Verified
PostTrainBench 1.1 — Claude CodeConfiguration: Claude Code harness32.0%posttrainbench.com for Kimi K3 on PostTrainBench 1.1 — Claude Code (opens in a new tab)Archived copy (opens in a new tab)PostTrainBench Weighted AggregateReported Benchmark leaderboardPostTrainBenchIndependentPostTrainBench TeamRecord for Kimi K3 on PostTrainBench 1.1 — Claude Code
PostTrainBench 1.2 — Claude CodeConfiguration: Claude Code harness31.5%posttrainbench.com for Kimi K3 on PostTrainBench 1.2 — Claude Code (opens in a new tab)Archived copy (opens in a new tab)PostTrainBench Weighted AggregateReported Benchmark leaderboardPostTrainBenchIndependentPostTrainBench TeamRecord for Kimi K3 on PostTrainBench 1.2 — Claude Code
Riemann-bench October 2026 leaderboardEffort: Max37.6%surgehq.ai for Kimi K3 (Max) on Riemann-bench October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Riemann-bench Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Kimi K3 on Riemann-bench October 2026 leaderboard
SimpleQA Verified Original — Epoch AI harnessEffort: MaxConfiguration: Epoch AI harness50.6%epoch.ai for Kimi K3 (max) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Kimi K3 on SimpleQA Verified Original — Epoch AI harness
SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 250 steps, 1 hour52.7%mercor.com for Kimi K3 (max) on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
SWE-bench Multilingual — Mercor mini-swe-agent, 1000 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 1000 steps, 3 hours91.4%mercor.com for Kimi K3 (max) on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps
SWE-bench Verified — Mercor mini-swe-agent, 1000 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 1000 steps, 3 hours83.3%mercor.com for Kimi K3 (max) on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps
SWE-bench Verified — Vals AI mini-swe-agentConfiguration: mini-swe-agent harness93.4%vals.ai for Kimi K3 on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardVals AIIndependentRecord for Kimi K3 on SWE-bench Verified — Vals AI mini-swe-agent
Terminal-Bench 2.1Effort: Max88.3%huggingface.co for Kimi K3 (max) on Terminal-Bench 2.1 (opens in a new tab)Terminal-Bench AccuracyReported Model cardMoonshot AISelf-reportedRecord for Kimi K3 on Terminal-Bench 2.1
Terminal-Bench 2.1 — Mercor Terminus 2Effort: MaxConfiguration: Mercor Terminus 2, 1000 steps, 3 hours82.0%mercor.com for Kimi K3 (max) on Terminal-Bench 2.1 — Mercor Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on Terminal-Bench 2.1 — Mercor Terminus 2
Terminal-Bench 2.1 — Vals AI Terminus 2Configuration: Terminus-2 harness80.9%vals.ai for Kimi K3 on Terminal-Bench 2.1 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Kimi K3 on Terminal-Bench 2.1 — Vals AI Terminus 2
Terminal-Bench 4.0 — Mercor mini-swe-agentEffort: MaxConfiguration: Mercor mini-swe-agent, 1000 steps, 8 hours26.3%mercor.com for Kimi K3 (max) on Terminal-Bench 4.0 — Mercor mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for Kimi K3 on Terminal-Bench 4.0 — Mercor mini-swe-agent
Terminal-Bench 4.0 — Vals AI mini-swe-agentEffort: MaxConfiguration: mini-swe-agent harness17.2%vals.ai for Kimi K3 (max) on Terminal-Bench 4.0 — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Kimi K3 on Terminal-Bench 4.0 — Vals AI mini-swe-agent
Toolathlon VerifiedEffort: Max76.5%toolathlon.xyz for Kimi K3 (max) on Toolathlon Verified (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for Kimi K3 on Toolathlon Verified
Vals Index 2.1Effort: Max50.3%vals.ai for Kimi K3 (max) on Vals Index 2.1 (opens in a new tab)Archived copy (opens in a new tab)Vals Index GDP-weighted AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Kimi K3 on Vals Index 2.1
Vibe Code Bench 1.1 — OpenHands, October 2026 evaluationEffort: MaxConfiguration: OpenHands harness85.0%vals.ai for Kimi K3 (max) on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for Kimi K3 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation