Benchmarks

34 results across 19 benchmarks

Benchmark results for Kimi K2.5
BenchmarkScoreSource
BrowseCompReported as: thinking60.6%huggingface.co for Kimi K2.5 (thinking) on BrowseComp BrowseComp (opens in a new tab)BrowseComp AccuracyReported Model cardMoonshot AISelf-reportedRecord for Kimi K2.5 on BrowseComp BrowseComp
Chartography October 2026 leaderboardReported as: Thinking on12.6%surgehq.ai for Kimi K2.5 (Thinking on) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Kimi K2.5 on Chartography October 2026 leaderboard
CharXiv Reasoning — No toolsReported as: thinkingConfiguration: No tools77.5%huggingface.co for Kimi K2.5 (thinking) on CharXiv Reasoning — No tools (opens in a new tab)CharXiv AccuracyReported Model cardMoonshot AISelf-reportedRecord for Kimi K2.5 on CharXiv Reasoning — No tools
Finance Agent Benchmark 2 — October 2026 evaluationReported as: thinking35.8%vals.ai for Kimi K2.5 (thinking) on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Finance Agent AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Kimi K2.5 on Finance Agent Benchmark 2 — October 2026 evaluation
GPQA DiamondReported as: thinking87.6%huggingface.co for Kimi K2.5 (thinking) on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Model cardMoonshot AISelf-reportedRecord for Kimi K2.5 on Graduate-Level Google-Proof Q&A Diamond
GPQA Diamond — Epoch AI harnessConfiguration: Epoch AI harness87.6%epoch.ai for Kimi K2.5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Kimi K2.5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Vals AI harnessReported as: thinkingConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT84.1%vals.ai for Kimi K2.5 (thinking) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Kimi K2.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
HLAB October 2026 evaluationReported as: thinking0.0%vals.ai for Kimi K2.5 (thinking) on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)HLAB Task Pass RateReported Benchmark leaderboardVals AIIndependentRecord for Kimi K2.5 on Harvey's Legal Agent Benchmark October 2026 evaluation
Humanity's Last Exam Full set — No toolsReported as: thinkingConfiguration: No tools30.1%huggingface.co for Kimi K2.5 (thinking) on Humanity's Last Exam Full set — No tools (opens in a new tab)Humanity's Last Exam AccuracyReported Model cardMoonshot AISelf-reportedRecord for Kimi K2.5 on Humanity's Last Exam Full set — No tools
Humanity's Last Exam Full set — Scale AI evaluation24.4%labs.scale.com for Kimi K2.5 on Humanity's Last Exam Full set — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Kimi K2.5 on Humanity's Last Exam Full set — Scale AI evaluation
Humanity's Last Exam Full set — With toolsReported as: thinkingConfiguration: With tools50.2%huggingface.co for Kimi K2.5 (thinking) on Humanity's Last Exam Full set — With tools (opens in a new tab)Humanity's Last Exam AccuracyReported Model cardMoonshot AISelf-reportedRecord for Kimi K2.5 on Humanity's Last Exam Full set — With tools
MCP Atlas Public, April 2026 update64.4%labs.scale.com for Kimi K2.5 on MCP Atlas Public, April 2026 update (opens in a new tab)Pass rateReported Benchmark leaderboardScale AIIndependentRecord for Kimi K2.5 on MCP Atlas Public, April 2026 update
MMLU-Pro OriginalReported as: thinking87.1%huggingface.co for Kimi K2.5 (thinking) on MMLU-Pro Original (opens in a new tab)AccuracyReported Model cardMoonshot AISelf-reportedRecord for Kimi K2.5 on MMLU-Pro Original
MMLU-Pro Original — Vals AI harnessReported as: thinkingConfiguration: Vals AI harness85.9%vals.ai for Kimi K2.5 (thinking) on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Kimi K2.5 on MMLU-Pro Original — Vals AI harness
MMMU-Pro No toolsReported as: thinkingConfiguration: No tools78.5%huggingface.co for Kimi K2.5 (thinking) on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Model cardMoonshot AISelf-reportedRecord for Kimi K2.5 on MMMU-Pro No tools
MMMU-Pro Vals AI harnessReported as: thinkingConfiguration: Vals AI harness84.3%vals.ai for Kimi K2.5 (thinking) on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for Kimi K2.5 on MMMU-Pro Vals AI harness
OSWorld Verified — 100 stepsConfiguration: 100-step limit63.3%os-world.github.io for Kimi K2.5 on OSWorld Verified — 100 steps (opens in a new tab)Archived copy (opens in a new tab)OSWorld-Verified success rateReported Benchmark leaderboardOSWorldIndependentXLang LabRecord for Kimi K2.5 on OSWorld Verified — 100 steps
Riemann-bench October 2026 leaderboardReported as: Thinking on12.0%surgehq.ai for Kimi K2.5 (Thinking on) on Riemann-bench October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Riemann-bench Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Kimi K2.5 on Riemann-bench October 2026 leaderboard
SimpleQA Verified Original — Epoch AI harnessConfiguration: Epoch AI harness34.3%epoch.ai for Kimi K2.5 on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Kimi K2.5 on SimpleQA Verified Original — Epoch AI harness
SWE Atlas Codebase QnA — Public; mini-swe-agentConfiguration: mini-swe-agent harness13.1%labs.scale.com for Kimi K2.5 on SWE Atlas Codebase QnA — Public; mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Kimi K2.5 on SWE Atlas Codebase QnA — Public; mini-swe-agent
SWE Atlas Refactoring — mini-swe-agentConfiguration: mini-swe-agent harness21.0%labs.scale.com for Kimi K2.5 on SWE Atlas Refactoring — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for Kimi K2.5 on SWE Atlas Refactoring — mini-swe-agent
SWE-bench MultilingualEffort: NoneReported as: non-thinking73.0%huggingface.co for Kimi K2.5 (non-thinking) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Model cardMoonshot AISelf-reportedRecord for Kimi K2.5 on SWE-bench Multilingual
SWE-bench Multilingual — mini-swe-agentConfiguration: mini-swe-agent harness67.3%github.com for Kimi K2.5 on SWE-bench Multilingual — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark repositorySWE-benchIndependentSWE-bench TeamRecord for Kimi K2.5 on SWE-bench Multilingual — mini-swe-agent
SWE-bench VerifiedEffort: NoneReported as: non-thinking76.8%huggingface.co for Kimi K2.5 (non-thinking) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model cardMoonshot AISelf-reportedRecord for Kimi K2.5 on SWE-bench Verified
SWE-bench Verified — Epoch AI harnessConfiguration: Epoch AI harness73.8%epoch.ai for Kimi K2.5 on SWE-bench Verified — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for Kimi K2.5 on SWE-bench Verified — Epoch AI harness
SWE-bench Verified — mini-swe-agentEffort: HighConfiguration: mini-swe-agent harness70.8%github.com for Kimi K2.5 (high) on SWE-bench Verified — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark repositorySWE-benchIndependentSWE-bench TeamRecord for Kimi K2.5 on SWE-bench Verified — mini-swe-agent
SWE-bench Verified — Vals AI mini-swe-agentReported as: thinkingConfiguration: mini-swe-agent harness70.0%vals.ai for Kimi K2.5 (thinking) on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardVals AIIndependentRecord for Kimi K2.5 on SWE-bench Verified — Vals AI mini-swe-agent
SWE-bench Pro PublicEffort: NoneReported as: non-thinking50.7%huggingface.co for Kimi K2.5 (non-thinking) on SWE-bench Pro Public (opens in a new tab)Public tasks resolvedReported Model cardMoonshot AISelf-reportedRecord for Kimi K2.5 on SWE-bench Pro Public
Terminal-Bench 2.0Effort: NoneReported as: non-thinking50.8%huggingface.co for Kimi K2.5 (non-thinking) on Terminal-Bench 2.0 (opens in a new tab)Terminal-Bench AccuracyReported Model cardMoonshot AISelf-reportedRecord for Kimi K2.5 on Terminal-Bench 2.0
Terminal-Bench 2.0 — Vals AI Terminus 2Reported as: thinkingConfiguration: Terminus-2 harness40.4%vals.ai for Kimi K2.5 (thinking) on Terminal-Bench 2.0 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Kimi K2.5 on Terminal-Bench 2.0 — Vals AI Terminus 2
Terminal-Bench 2.1 — Vals AI Terminus 2Reported as: thinkingConfiguration: Terminus-2 harness41.9%vals.ai for Kimi K2.5 (thinking) on Terminal-Bench 2.1 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Kimi K2.5 on Terminal-Bench 2.1 — Vals AI Terminus 2
Toolathlon Original27.8%toolathlon.xyz for Kimi K2.5 on Toolathlon Original (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for Kimi K2.5 on Toolathlon Original
Toolathlon Verified33.0%toolathlon.xyz for Kimi K2.5 on Toolathlon Verified (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for Kimi K2.5 on Toolathlon Verified
Vibe Code Bench 1.1 — OpenHands, October 2026 evaluationReported as: thinkingConfiguration: OpenHands harness17.5%vals.ai for Kimi K2.5 (thinking) on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for Kimi K2.5 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation