Scores over time

Best recorded score per model; higher is better. The line follows the running best. Evaluation contexts can differ.

Humanity's Last Exam Accuracy scores over timeOne point per model's best recorded score, dated by reported date or model release date. A line shows the running best. The data table below contains every plotted point.54.174.972026-10-072026-10-07GLM-4.5-Air: 9.4% · Reported 2026-10-07GPT-5.2: 28.5% · Reported 2026-10-07OpenAI o4-mini: 18.9% · Reported 2026-10-07GPT-4.5 Preview: 5.8% · Reported 2026-10-07Claude Opus 4.1: 11.3% · Reported 2026-10-07GPT-5 mini: 19.7% · Reported 2026-10-07Muse Spark: 40.9% · Reported 2026-10-07GPT-4.1: 5.0% · Reported 2026-10-07OpenAI o3: 20.6% · Reported 2026-10-07Gemini 2.5 Pro: 18.4% · Reported 2026-10-07Claude Sonnet 4.5: 14.1% · Reported 2026-10-07GPT-5.4: 36.5% · Reported 2026-10-07GPT-6 Astra: 54.2% · Reported 2026-10-07Gemini 3.1 Pro: 47.3% · Reported 2026-10-07Gemini 2.5 Flash: 12.6% · Reported 2026-10-07GLM-4.5: 9.6% · Reported 2026-10-07gpt-oss-120b: 15.5% · Reported 2026-10-07Claude Sonnet 4: 7.6% · Reported 2026-10-07GPT-5: 26.3% · Reported 2026-10-07Gemini 3 Pro: 37.7% · Reported 2026-10-07Claude Opus 4.5: 26.3% · Reported 2026-10-07Claude Fable 5.1: 46.8% · Reported 2026-10-07Claude 3.7 Sonnet: 7.9% · Reported 2026-10-07Gemini 3.8 Flash: 45.0% · Reported 2026-10-07Claude Opus 4: 10.8% · Reported 2026-10-07Claude Opus 4.6: 36.2% · Reported 2026-10-07
Data table
Scores plotted over time
ModelDateScore
GLM-4.5-Air (Reported)9.4%
GPT-5.2 (Reported)28.5%
OpenAI o4-mini (Reported)18.9%
GPT-4.5 Preview (Reported)5.8%
Claude Opus 4.1 (Reported)11.3%
GPT-5 mini (Reported)19.7%
Muse Spark (Reported)40.9%
GPT-4.1 (Reported)5.0%
OpenAI o3 (Reported)20.6%
Gemini 2.5 Pro (Reported)18.4%
Claude Sonnet 4.5 (Reported)14.1%
GPT-5.4 (Reported)36.5%
GPT-6 Astra (Reported)54.2%
Gemini 3.1 Pro (Reported)47.3%
Gemini 2.5 Flash (Reported)12.6%
GLM-4.5 (Reported)9.6%
gpt-oss-120b (Reported)15.5%
Claude Sonnet 4 (Reported)7.6%
GPT-5 (Reported)26.3%
Gemini 3 Pro (Reported)37.7%
Claude Opus 4.5 (Reported)26.3%
Claude Fable 5.1 (Reported)46.8%
Claude 3.7 Sonnet (Reported)7.9%
Gemini 3.8 Flash (Reported)45.0%
Claude Opus 4 (Reported)10.8%
Claude Opus 4.6 (Reported)36.2%

Results

34 results

Humanity's Last Exam Text only — Scale AI evaluation results
ProviderModelScoreSourceRegistry No.
OpenAIGPT-4.5 Preview5.8%labs.scale.com for GPT-4.5 Preview on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for GPT-4.5 Preview on Humanity's Last Exam Text only — Scale AI evaluation10001
OpenAIGPT-4.15.0%labs.scale.com for GPT-4.1 on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for GPT-4.1 on Humanity's Last Exam Text only — Scale AI evaluation10002
OpenAIOpenAI o3 (high)20.6%labs.scale.com for OpenAI o3 (high) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for OpenAI o3 on Humanity's Last Exam Text only — Scale AI evaluation10003
OpenAIOpenAI o3 (medium)19.8%labs.scale.com for OpenAI o3 (medium) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for OpenAI o3 on Humanity's Last Exam Text only — Scale AI evaluation10003
OpenAIOpenAI o4-mini (high)18.9%labs.scale.com for OpenAI o4-mini (high) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for OpenAI o4-mini on Humanity's Last Exam Text only — Scale AI evaluation10004
OpenAIOpenAI o4-mini (medium)14.5%labs.scale.com for OpenAI o4-mini (medium) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for OpenAI o4-mini on Humanity's Last Exam Text only — Scale AI evaluation10004
OpenAIGPT-6 Astra54.2%labs.scale.com for GPT-6 Astra on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for GPT-6 Astra on Humanity's Last Exam Text only — Scale AI evaluation10005
OpenAIGPT-5.4 (xhigh thinking)36.5%labs.scale.com for GPT-5.4 (xhigh thinking) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for GPT-5.4 on Humanity's Last Exam Text only — Scale AI evaluation10007
OpenAIGPT-5.228.5%labs.scale.com for GPT-5.2 on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for GPT-5.2 on Humanity's Last Exam Text only — Scale AI evaluation10012
OpenAIGPT-526.3%labs.scale.com for GPT-5 on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for GPT-5 on Humanity's Last Exam Text only — Scale AI evaluation10018
OpenAIGPT-5 mini19.7%labs.scale.com for GPT-5 mini on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for GPT-5 mini on Humanity's Last Exam Text only — Scale AI evaluation10019
Z.aiGLM-4.59.6%labs.scale.com for GLM-4.5 on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for GLM-4.5 on Humanity's Last Exam Text only — Scale AI evaluation150007
Z.aiGLM-4.5-Air9.4%labs.scale.com for GLM-4.5-Air on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for GLM-4.5-Air on Humanity's Last Exam Text only — Scale AI evaluation150008
OpenAIgpt-oss-120b15.5%labs.scale.com for gpt-oss-120b on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for gpt-oss-120b on Humanity's Last Exam Text only — Scale AI evaluation15001
AnthropicClaude 3.7 Sonnet (Thinking)7.9%labs.scale.com for Claude 3.7 Sonnet (Thinking) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude 3.7 Sonnet on Humanity's Last Exam Text only — Scale AI evaluation20001
AnthropicClaude Opus 46.3%labs.scale.com for Claude Opus 4 on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4 on Humanity's Last Exam Text only — Scale AI evaluation20002
AnthropicClaude Opus 4 (Thinking)10.8%labs.scale.com for Claude Opus 4 (Thinking) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4 on Humanity's Last Exam Text only — Scale AI evaluation20002
AnthropicClaude Sonnet 4 (Thinking)7.6%labs.scale.com for Claude Sonnet 4 (Thinking) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Sonnet 4 on Humanity's Last Exam Text only — Scale AI evaluation20003
AnthropicClaude Sonnet 45.4%labs.scale.com for Claude Sonnet 4 on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Sonnet 4 on Humanity's Last Exam Text only — Scale AI evaluation20003
AnthropicClaude Fable 5.1 (xhigh)46.8%labs.scale.com for Claude Fable 5.1 (xhigh) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Fable 5.1 on Humanity's Last Exam Text only — Scale AI evaluation20004
AnthropicClaude Sonnet 4.57.7%labs.scale.com for Claude Sonnet 4.5 on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Sonnet 4.5 on Humanity's Last Exam Text only — Scale AI evaluation20005
AnthropicClaude Sonnet 4.5 (thinking)14.1%labs.scale.com for Claude Sonnet 4.5 (thinking) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Sonnet 4.5 on Humanity's Last Exam Text only — Scale AI evaluation20005
AnthropicClaude Opus 4.5 (thinking)26.3%labs.scale.com for Claude Opus 4.5 (thinking) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.5 on Humanity's Last Exam Text only — Scale AI evaluation20007
AnthropicClaude Opus 4.513.9%labs.scale.com for Claude Opus 4.5 on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.5 on Humanity's Last Exam Text only — Scale AI evaluation20007
AnthropicClaude Opus 4.6 (Non-Thinking)19.4%labs.scale.com for Claude Opus 4.6 (Non-Thinking) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.6 on Humanity's Last Exam Text only — Scale AI evaluation20008
AnthropicClaude Opus 4.6 (thinking-max)36.2%labs.scale.com for Claude Opus 4.6 (thinking-max) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.6 on Humanity's Last Exam Text only — Scale AI evaluation20008
AnthropicClaude Opus 4.1 (thinking)11.3%labs.scale.com for Claude Opus 4.1 (thinking) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.1 on Humanity's Last Exam Text only — Scale AI evaluation20017
AnthropicClaude Opus 4.17.4%labs.scale.com for Claude Opus 4.1 on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Claude Opus 4.1 on Humanity's Last Exam Text only — Scale AI evaluation20017
Google (DeepMind)Gemini 2.5 Pro18.4%labs.scale.com for Gemini 2.5 Pro on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Gemini 2.5 Pro on Humanity's Last Exam Text only — Scale AI evaluation30002
Google (DeepMind)Gemini 2.5 Flash12.6%labs.scale.com for Gemini 2.5 Flash on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Gemini 2.5 Flash on Humanity's Last Exam Text only — Scale AI evaluation30003
Google (DeepMind)Gemini 3.8 Flash45.0%labs.scale.com for Gemini 3.8 Flash on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Gemini 3.8 Flash on Humanity's Last Exam Text only — Scale AI evaluation30004
Google (DeepMind)Gemini 3.1 Pro (thinking high)47.3%labs.scale.com for Gemini 3.1 Pro (thinking high) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Gemini 3.1 Pro on Humanity's Last Exam Text only — Scale AI evaluation30005
Google (DeepMind)Gemini 3 Pro37.7%labs.scale.com for Gemini 3 Pro on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Gemini 3 Pro on Humanity's Last Exam Text only — Scale AI evaluation30008
Meta AI (originally Facebook AI Research)Muse Spark40.9%labs.scale.com for Muse Spark on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for Muse Spark on Humanity's Last Exam Text only — Scale AI evaluation80001