Versions

1 version · Metric: Agent's Last Exam Binary Pass Rate

Versions of Agent's Last Exam
VersionReleasedModelsResults
Agent's Last Exam ALE-V1 — ALE-Claw, 5hConfiguration: ALE-Claw harness, 5hSeptember 30, 202611

Recently reported results: Agent's Last Exam ALE-V1 — ALE-Claw, 5h, ALE-Claw harness, 5h

Most recent configuration: Agent's Last Exam ALE-V1 — ALE-Claw, 5h

Recently reported results for Agent's Last Exam ALE-V1 — ALE-Claw, 5h
ModelScoreSource
Gemini 4 Argon (highest thinking settings)39.5%deepmind.google for Gemini 4 Argon (highest thinking settings) on Agent's Last Exam ALE-V1 — ALE-Claw, 5h (opens in a new tab)Agent's Last Exam Binary Pass RateReported Evaluation methodologyGoogle DeepMindSelf-reportedRecord for Gemini 4 Argon on Agent's Last Exam ALE-V1 — ALE-Claw, 5h