Results

21 results

Toolathlon Verified results
ProviderModelScoreSourceRegistry No.
AnthropicClaude Sonnet 5.5 (max)77.8%anthropic.com for Claude Sonnet 5.5 (max) on Toolathlon Verified (opens in a new tab)Tasks completedReported System cardAnthropicSelf-reportedRecord for Claude Sonnet 5.5 on Toolathlon Verified20016
Z.aiGLM-5.3-Flash (max)78.4%autoclaw.z.ai for GLM-5.3-Flash (max) on Toolathlon Verified (opens in a new tab)Tasks completedReported Launch postAutoClaw Team (Z.ai)Self-reportedZ.aiRecord for GLM-5.3-Flash on Toolathlon Verified150006
Z.aiGLM-5.3 (max)73.0%z.ai for GLM-5.3 (max) on Toolathlon Verified (opens in a new tab)Tasks completedReported Launch postZ.aiSelf-reportedRecord for GLM-5.3 on Toolathlon Verified150005
Meta AI (originally Facebook AI Research)Muse Spark 1.2 (xhigh)75.9%toolathlon.xyz for Muse Spark 1.2 (xhigh) on Toolathlon Verified (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for Muse Spark 1.2 on Toolathlon Verified80003
DeepSeek AIDeepSeek-V4-Flash (max)50.9%toolathlon.xyz for DeepSeek-V4-Flash (max) on Toolathlon Verified (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for DeepSeek-V4-Flash on Toolathlon Verified110001
Alibaba (Tongyi)Qwen3.5-397B-A17B40.7%toolathlon.xyz for Qwen3.5-397B-A17B on Toolathlon Verified (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for Qwen3.5-397B-A17B on Toolathlon Verified130003
MiniMaxMiniMax M2.747.5%toolathlon.xyz for MiniMax M2.7 on Toolathlon Verified (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for MiniMax M2.7 on Toolathlon Verified140002
Thinking Machines LabInkling-Small (effort=0.99)54.4%thinkingmachines.ai for Inkling-Small (effort=0.99) on Toolathlon Verified (opens in a new tab)Tasks completedReported Launch postThinking Machines LabSelf-reportedRecord for Inkling-Small on Toolathlon Verified160002
Moonshot AIKimi K3 (max)76.5%toolathlon.xyz for Kimi K3 (max) on Toolathlon Verified (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for Kimi K3 on Toolathlon Verified120003
Moonshot AIKimi K2.533.0%toolathlon.xyz for Kimi K2.5 on Toolathlon Verified (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for Kimi K2.5 on Toolathlon Verified120001
Moonshot AIKimi K2.658.0%toolathlon.xyz for Kimi K2.6 on Toolathlon Verified (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for Kimi K2.6 on Toolathlon Verified120002
Thinking Machines LabInkling (effort=0.99)45.5%thinkingmachines.ai for Inkling (effort=0.99) on Toolathlon Verified (opens in a new tab)Tasks completedReported Launch postThinking Machines LabSelf-reportedRecord for Inkling on Toolathlon Verified160001
NVIDIANVIDIA Nemotron 3 Ultra 550B-A55B34.3%toolathlon.xyz for NVIDIA Nemotron 3 Ultra 550B-A55B on Toolathlon Verified (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for NVIDIA Nemotron 3 Ultra 550B-A55B on Toolathlon Verified60003
Meta AI (originally Facebook AI Research)Muse Spark 1.1 (xhigh)75.6%dev.meta.ai for Muse Spark 1.1 (xhigh) on Toolathlon Verified (opens in a new tab)Tasks completedReported Model pageMetaSelf-reportedRecord for Muse Spark 1.1 on Toolathlon Verified80002
AnthropicClaude Sonnet 5 (max)71.6%toolathlon.xyz for Claude Sonnet 5 (max) on Toolathlon Verified (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for Claude Sonnet 5 on Toolathlon Verified20013
Google (DeepMind)Gemini 3.1 Pro (high)61.1%toolathlon.xyz for Gemini 3.1 Pro (high) on Toolathlon Verified (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for Gemini 3.1 Pro on Toolathlon Verified30005
OpenAIGPT-5.5 (xhigh)73.5%toolathlon.xyz for GPT-5.5 (xhigh) on Toolathlon Verified (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for GPT-5.5 on Toolathlon Verified10008
DeepSeek AIDeepSeek-V4-Pro (max)55.9%toolathlon.xyz for DeepSeek-V4-Pro (max) on Toolathlon Verified (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for DeepSeek-V4-Pro on Toolathlon Verified110002
Z.aiGLM-5.2 (max)59.9%toolathlon.xyz for GLM-5.2 (max) on Toolathlon Verified (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for GLM-5.2 on Toolathlon Verified150004
AnthropicClaude Opus 4.8 (max)76.2%toolathlon.xyz for Claude Opus 4.8 (max) on Toolathlon Verified (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for Claude Opus 4.8 on Toolathlon Verified20011
Google (DeepMind)Gemini 3.5 Flash (high)67.3%toolathlon.xyz for Gemini 3.5 Flash (high) on Toolathlon Verified (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for Gemini 3.5 Flash on Toolathlon Verified30006