Evidence checked

Recent benchmark records with evidence checked 2026-10-08
ModelBenchmarkScoreSource
Claude Haiku 5.5CursorBench 4.030.9%cursor.com for Claude Haiku 5.5 on CursorBench (opens in a new tab)Record for Claude Haiku 5.5 on CursorBench 4.0
Claude Haiku 5.5CursorBench 4.036.9%cursor.com for Claude Haiku 5.5 on CursorBench (opens in a new tab)Record for Claude Haiku 5.5 on CursorBench 4.0
Claude Haiku 5.5CursorBench 4.042.3%cursor.com for Claude Haiku 5.5 on CursorBench (opens in a new tab)Record for Claude Haiku 5.5 on CursorBench 4.0
Claude Haiku 5.5CursorBench 4.044.3%cursor.com for Claude Haiku 5.5 on CursorBench (opens in a new tab)Record for Claude Haiku 5.5 on CursorBench 4.0
Claude Haiku 5.5CursorBench 4.048.4%cursor.com for Claude Haiku 5.5 on CursorBench (opens in a new tab)Record for Claude Haiku 5.5 on CursorBench 4.0
Claude Haiku 5.5FrontierSWE 2 — October 2026 evaluation43.8%frontierswe.com for Claude Haiku 5.5 on FrontierSWE (opens in a new tab)Record for Claude Haiku 5.5 on FrontierSWE 2 — October 2026 evaluation
Claude Haiku 5.5SpatialBench Verified67.7%anthropic.com for Claude Haiku 5.5 on SpatialBench (opens in a new tab)Record for Claude Haiku 5.5 on SpatialBench Verified
Claude Haiku 5.5MILU Original87.6%anthropic.com for Claude Haiku 5.5 on Multi-task Indic Language Understanding Benchmark (opens in a new tab)Record for Claude Haiku 5.5 on Multi-task Indic Language Understanding Benchmark Original
Claude Haiku 5.5Global MMLU Original87.8%anthropic.com for Claude Haiku 5.5 on Global MMLU (opens in a new tab)Record for Claude Haiku 5.5 on Global MMLU Original
Claude Haiku 5.5Terminal-Bench Science 0.120.6%anthropic.com for Claude Haiku 5.5 on Terminal-Bench (opens in a new tab)Record for Claude Haiku 5.5 on Terminal-Bench Science 0.1
Claude Haiku 5.5Terminal-Bench 4.039.2%anthropic.com for Claude Haiku 5.5 on Terminal-Bench (opens in a new tab)Record for Claude Haiku 5.5 on Terminal-Bench 4.0
Claude Haiku 5.5Humanity's Last Exam Full set — With tools57.4%anthropic.com for Claude Haiku 5.5 on Humanity's Last Exam (opens in a new tab)Record for Claude Haiku 5.5 on Humanity's Last Exam Full set — With tools
Claude Haiku 5.5Humanity's Last Exam Full set — No tools45.9%anthropic.com for Claude Haiku 5.5 on Humanity's Last Exam (opens in a new tab)Record for Claude Haiku 5.5 on Humanity's Last Exam Full set — No tools
Claude Haiku 5.5SWE-bench Multilingual83.7%anthropic.com for Claude Haiku 5.5 on SWE-bench (opens in a new tab)Record for Claude Haiku 5.5 on SWE-bench Multilingual
Claude Haiku 5.5SWE-bench Pro Public64.8%anthropic.com for Claude Haiku 5.5 on SWE-bench Pro (opens in a new tab)Record for Claude Haiku 5.5 on SWE-bench Pro Public

Evidence checked

Recent benchmark records with evidence checked 2026-10-07
ModelBenchmarkScoreSource
Gemini 4 ArgonAPEX-Agents Original82.4%mercor.com for Gemini 4 Argon on APEX-Agents (opens in a new tab)Record for Gemini 4 Argon on APEX-Agents Original
Muse Spark 1.3APEX-Agents Original47.6%mercor.com for Muse Spark 1.3 on APEX-Agents (opens in a new tab)Record for Muse Spark 1.3 on APEX-Agents Original
GPT-6.1 SolAPEX-Agents Original60.0%mercor.com for GPT-6.1 Sol on APEX-Agents (opens in a new tab)Record for GPT-6.1 Sol on APEX-Agents Original
Claude Sonnet 5.5APEX-Agents Original75.5%mercor.com for Claude Sonnet 5.5 on APEX-Agents (opens in a new tab)Record for Claude Sonnet 5.5 on APEX-Agents Original
Claude Sonnet 5.5APEX-Agents Original44.6%mercor.com for Claude Sonnet 5.5 on APEX-Agents (opens in a new tab)Record for Claude Sonnet 5.5 on APEX-Agents Original
Muse Spark 1.1APEX-Agents Original31.8%mercor.com for Muse Spark 1.1 on APEX-Agents (opens in a new tab)Record for Muse Spark 1.1 on APEX-Agents Original
GPT-6 SolAPEX-Agents Original54.3%mercor.com for GPT-6 Sol on APEX-Agents (opens in a new tab)Record for GPT-6 Sol on APEX-Agents Original
GPT-6 LunaAPEX-Agents Original44.3%mercor.com for GPT-6 Luna on APEX-Agents (opens in a new tab)Record for GPT-6 Luna on APEX-Agents Original
Claude Opus 5.5APEX-Agents Original73.5%mercor.com for Claude Opus 5.5 on APEX-Agents (opens in a new tab)Record for Claude Opus 5.5 on APEX-Agents Original
Claude Opus 5.5APEX-Agents Original52.5%mercor.com for Claude Opus 5.5 on APEX-Agents (opens in a new tab)Record for Claude Opus 5.5 on APEX-Agents Original
NVIDIA Nemotron 3 Ultra 550B-A55BAPEX-Agents Original22.7%mercor.com for NVIDIA Nemotron 3 Ultra 550B-A55B on APEX-Agents (opens in a new tab)Record for NVIDIA Nemotron 3 Ultra 550B-A55B on APEX-Agents Original
Qwen3.8-MaxAPEX-Agents Original63.3%mercor.com for Qwen3.8-Max on APEX-Agents (opens in a new tab)Record for Qwen3.8-Max on APEX-Agents Original
GLM-5.2APEX-Agents Original45.2%mercor.com for GLM-5.2 on APEX-Agents (opens in a new tab)Record for GLM-5.2 on APEX-Agents Original
GPT-5.6 LunaAPEX-Agents Original43.0%mercor.com for GPT-5.6 Luna on APEX-Agents (opens in a new tab)Record for GPT-5.6 Luna on APEX-Agents Original
DeepSeek-V3.2APEX-Agents Original21.3%mercor.com for DeepSeek-V3.2 on APEX-Agents (opens in a new tab)Record for DeepSeek-V3.2 on APEX-Agents Original
Grok 4.7APEX-Agents Original54.6%mercor.com for Grok 4.7 on APEX-Agents (opens in a new tab)Record for Grok 4.7 on APEX-Agents Original
GLM-5.1APEX-Agents Original40.9%mercor.com for GLM-5.1 on APEX-Agents (opens in a new tab)Record for GLM-5.1 on APEX-Agents Original
Claude Sonnet 4.6APEX-Agents Original43.0%mercor.com for Claude Sonnet 4.6 on APEX-Agents (opens in a new tab)Record for Claude Sonnet 4.6 on APEX-Agents Original
MiniMax M3APEX-Agents Original37.7%mercor.com for MiniMax M3 on APEX-Agents (opens in a new tab)Record for MiniMax M3 on APEX-Agents Original
InklingAPEX-Agents Original33.8%mercor.com for Inkling on APEX-Agents (opens in a new tab)Record for Inkling on APEX-Agents Original
Gemini 3.1 ProAPEX-Agents Original35.3%mercor.com for Gemini 3.1 Pro on APEX-Agents (opens in a new tab)Record for Gemini 3.1 Pro on APEX-Agents Original
Claude Fable 5.1APEX-Agents Original59.7%mercor.com for Claude Fable 5.1 on APEX-Agents (opens in a new tab)Record for Claude Fable 5.1 on APEX-Agents Original
Qwen3.5-397B-A17BAPEX-Agents Original24.9%mercor.com for Qwen3.5-397B-A17B on APEX-Agents (opens in a new tab)Record for Qwen3.5-397B-A17B on APEX-Agents Original
gpt-oss-120bAPEX-Agents Original4.4%mercor.com for gpt-oss-120b on APEX-Agents (opens in a new tab)Record for gpt-oss-120b on APEX-Agents Original
Muse Spark 1.3APEX-Agents Original58.6%mercor.com for Muse Spark 1.3 on APEX-Agents (opens in a new tab)Record for Muse Spark 1.3 on APEX-Agents Original
Muse Spark 1.2APEX-Agents Original36.4%mercor.com for Muse Spark 1.2 on APEX-Agents (opens in a new tab)Record for Muse Spark 1.2 on APEX-Agents Original
Gemini 3.6 FlashAPEX-Agents Original46.9%mercor.com for Gemini 3.6 Flash on APEX-Agents (opens in a new tab)Record for Gemini 3.6 Flash on APEX-Agents Original
Gemini 3.5 FlashAPEX-Agents Original27.5%mercor.com for Gemini 3.5 Flash on APEX-Agents (opens in a new tab)Record for Gemini 3.5 Flash on APEX-Agents Original
Claude Opus 4.6APEX-Agents Original46.3%mercor.com for Claude Opus 4.6 on APEX-Agents (opens in a new tab)Record for Claude Opus 4.6 on APEX-Agents Original
Claude Opus 4.8APEX-Agents Original48.9%mercor.com for Claude Opus 4.8 on APEX-Agents (opens in a new tab)Record for Claude Opus 4.8 on APEX-Agents Original
Claude Opus 4.7APEX-Agents Original49.2%mercor.com for Claude Opus 4.7 on APEX-Agents (opens in a new tab)Record for Claude Opus 4.7 on APEX-Agents Original
Kimi K3APEX-Agents Original50.6%mercor.com for Kimi K3 on APEX-Agents (opens in a new tab)Record for Kimi K3 on APEX-Agents Original
GPT-5.4APEX-Agents Original52.4%mercor.com for GPT-5.4 on APEX-Agents (opens in a new tab)Record for GPT-5.4 on APEX-Agents Original
GLM-5.3-FlashAPEX-Agents Original52.8%mercor.com for GLM-5.3-Flash on APEX-Agents (opens in a new tab)Record for GLM-5.3-Flash on APEX-Agents Original
Claude Sonnet 5APEX-Agents Original54.5%mercor.com for Claude Sonnet 5 on APEX-Agents (opens in a new tab)Record for Claude Sonnet 5 on APEX-Agents Original
GPT-5.5APEX-Agents Original55.1%mercor.com for GPT-5.5 on APEX-Agents (opens in a new tab)Record for GPT-5.5 on APEX-Agents Original
Grok 4.5APEX-Agents Original56.2%mercor.com for Grok 4.5 on APEX-Agents (opens in a new tab)Record for Grok 4.5 on APEX-Agents Original
GLM-5.3APEX-Agents Original56.6%mercor.com for GLM-5.3 on APEX-Agents (opens in a new tab)Record for GLM-5.3 on APEX-Agents Original
GPT-5.6 TerraAPEX-Agents Original58.2%mercor.com for GPT-5.6 Terra on APEX-Agents (opens in a new tab)Record for GPT-5.6 Terra on APEX-Agents Original
Claude Fable 5APEX-Agents Original63.6%mercor.com for Claude Fable 5 on APEX-Agents (opens in a new tab)Record for Claude Fable 5 on APEX-Agents Original
Gemini 3.8 FlashAPEX-Agents Original64.3%mercor.com for Gemini 3.8 Flash on APEX-Agents (opens in a new tab)Record for Gemini 3.8 Flash on APEX-Agents Original
Grok 4.6APEX-Agents Original65.3%mercor.com for Grok 4.6 on APEX-Agents (opens in a new tab)Record for Grok 4.6 on APEX-Agents Original
GPT-6 AstraAPEX-Agents Original64.7%mercor.com for GPT-6 Astra on APEX-Agents (opens in a new tab)Record for GPT-6 Astra on APEX-Agents Original
Claude Opus 5APEX-Agents Original65.8%mercor.com for Claude Opus 5 on APEX-Agents (opens in a new tab)Record for Claude Opus 5 on APEX-Agents Original
Gemini 3.7 FlashAPEX-Agents Original67.8%mercor.com for Gemini 3.7 Flash on APEX-Agents (opens in a new tab)Record for Gemini 3.7 Flash on APEX-Agents Original
Claude Fable 5.1APEX-Agents Original68.6%mercor.com for Claude Fable 5.1 on APEX-Agents (opens in a new tab)Record for Claude Fable 5.1 on APEX-Agents Original
Grok 4.7SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps47.0%mercor.com for Grok 4.7 on SWE Atlas (opens in a new tab)Record for Grok 4.7 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
MiniMax M3SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps37.9%mercor.com for MiniMax M3 on SWE Atlas (opens in a new tab)Record for MiniMax M3 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
Muse Spark 1.1SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps3.9%mercor.com for Muse Spark 1.1 on SWE Atlas (opens in a new tab)Record for Muse Spark 1.1 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
GPT-6 AstraSWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps47.8%mercor.com for GPT-6 Astra on SWE Atlas (opens in a new tab)Record for GPT-6 Astra on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
Qwen3.8-MaxSWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps50.5%mercor.com for Qwen3.8-Max on SWE Atlas (opens in a new tab)Record for Qwen3.8-Max on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
Grok 4.6SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps50.3%mercor.com for Grok 4.6 on SWE Atlas (opens in a new tab)Record for Grok 4.6 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
GPT-6.1 SolSWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps48.4%mercor.com for GPT-6.1 Sol on SWE Atlas (opens in a new tab)Record for GPT-6.1 Sol on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
Claude Fable 5.1SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps43.3%mercor.com for Claude Fable 5.1 on SWE Atlas (opens in a new tab)Record for Claude Fable 5.1 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
Claude Sonnet 5.5SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps50.3%mercor.com for Claude Sonnet 5.5 on SWE Atlas (opens in a new tab)Record for Claude Sonnet 5.5 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
GPT-6 AstraSWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps48.9%mercor.com for GPT-6 Astra on SWE Atlas (opens in a new tab)Record for GPT-6 Astra on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
GLM-5.3SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps42.5%mercor.com for GLM-5.3 on SWE Atlas (opens in a new tab)Record for GLM-5.3 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
Claude Opus 5.5SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps48.9%mercor.com for Claude Opus 5.5 on SWE Atlas (opens in a new tab)Record for Claude Opus 5.5 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
GPT-6 SolSWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps44.1%mercor.com for GPT-6 Sol on SWE Atlas (opens in a new tab)Record for GPT-6 Sol on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
GPT-6 LunaSWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps33.9%mercor.com for GPT-6 Luna on SWE Atlas (opens in a new tab)Record for GPT-6 Luna on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
Claude Fable 5.1SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps42.7%mercor.com for Claude Fable 5.1 on SWE Atlas (opens in a new tab)Record for Claude Fable 5.1 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
GPT-5.6 TerraSWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps45.2%mercor.com for GPT-5.6 Terra on SWE Atlas (opens in a new tab)Record for GPT-5.6 Terra on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
GPT-5.6 LunaSWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps46.0%mercor.com for GPT-5.6 Luna on SWE Atlas (opens in a new tab)Record for GPT-5.6 Luna on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
Claude Sonnet 4.6SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps35.5%mercor.com for Claude Sonnet 4.6 on SWE Atlas (opens in a new tab)Record for Claude Sonnet 4.6 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
Claude Opus 5SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps50.3%mercor.com for Claude Opus 5 on SWE Atlas (opens in a new tab)Record for Claude Opus 5 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
Claude Opus 4.8SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps44.4%mercor.com for Claude Opus 4.8 on SWE Atlas (opens in a new tab)Record for Claude Opus 4.8 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
Claude Opus 4.7SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps47.0%mercor.com for Claude Opus 4.7 on SWE Atlas (opens in a new tab)Record for Claude Opus 4.7 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
GPT-5.4SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps37.1%mercor.com for GPT-5.4 on SWE Atlas (opens in a new tab)Record for GPT-5.4 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
Claude Fable 5SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps33.1%mercor.com for Claude Fable 5 on SWE Atlas (opens in a new tab)Record for Claude Fable 5 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
InklingSWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps21.2%mercor.com for Inkling on SWE Atlas (opens in a new tab)Record for Inkling on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
GLM-5.2SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps46.0%mercor.com for GLM-5.2 on SWE Atlas (opens in a new tab)Record for GLM-5.2 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
Kimi K3SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps52.7%mercor.com for Kimi K3 on SWE Atlas (opens in a new tab)Record for Kimi K3 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
Claude Sonnet 5SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps39.5%mercor.com for Claude Sonnet 5 on SWE Atlas (opens in a new tab)Record for Claude Sonnet 5 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
DeepSeek-V3.2SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps5.9%mercor.com for DeepSeek-V3.2 on SWE Atlas (opens in a new tab)Record for DeepSeek-V3.2 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
DeepSeek-V4-ProSWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps25.0%mercor.com for DeepSeek-V4-Pro on SWE Atlas (opens in a new tab)Record for DeepSeek-V4-Pro on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
GPT-5.5SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps45.2%mercor.com for GPT-5.5 on SWE Atlas (opens in a new tab)Record for GPT-5.5 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
Grok 4.5SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps41.9%mercor.com for Grok 4.5 on SWE Atlas (opens in a new tab)Record for Grok 4.5 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
Gemini 3.6 FlashSWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps32.0%mercor.com for Gemini 3.6 Flash on SWE Atlas (opens in a new tab)Record for Gemini 3.6 Flash on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
Gemini 3.5 FlashSWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps19.6%mercor.com for Gemini 3.5 Flash on SWE Atlas (opens in a new tab)Record for Gemini 3.5 Flash on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
Gemini 3.1 ProSWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps18.0%mercor.com for Gemini 3.1 Pro on SWE Atlas (opens in a new tab)Record for Gemini 3.1 Pro on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
GPT-6.1 SolMedXpertQA MM — Mercor single-shot85.7%mercor.com for GPT-6.1 Sol on MedXpertQA (opens in a new tab)Record for GPT-6.1 Sol on MedXpertQA MM — Mercor single-shot
Claude Fable 5.1MedXpertQA MM — Mercor single-shot83.7%mercor.com for Claude Fable 5.1 on MedXpertQA (opens in a new tab)Record for Claude Fable 5.1 on MedXpertQA MM — Mercor single-shot
Claude Sonnet 5.5MedXpertQA MM — Mercor single-shot80.7%mercor.com for Claude Sonnet 5.5 on MedXpertQA (opens in a new tab)Record for Claude Sonnet 5.5 on MedXpertQA MM — Mercor single-shot
Claude Opus 5.5MedXpertQA MM — Mercor single-shot85.7%mercor.com for Claude Opus 5.5 on MedXpertQA (opens in a new tab)Record for Claude Opus 5.5 on MedXpertQA MM — Mercor single-shot
GPT-6 SolMedXpertQA MM — Mercor single-shot81.3%mercor.com for GPT-6 Sol on MedXpertQA (opens in a new tab)Record for GPT-6 Sol on MedXpertQA MM — Mercor single-shot