Benchmarks

58 results across 22 benchmarks

Benchmark results for GPT-5.6 Luna
BenchmarkScoreSource
APEX-Agents OriginalEffort: Max43.0%mercor.com for GPT-5.6 Luna (max) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for GPT-5.6 Luna on APEX-Agents Original
AutomationBench 1.0.6Effort: Low1.8%openai.com for GPT-5.6 Luna (low) on AutomationBench 1.0.6 (opens in a new tab)Task pass rateReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on AutomationBench 1.0.6
AutomationBench 1.0.6Effort: Medium4.3%openai.com for GPT-5.6 Luna (medium) on AutomationBench 1.0.6 (opens in a new tab)Task pass rateReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on AutomationBench 1.0.6
AutomationBench 1.0.6Effort: High9.1%openai.com for GPT-5.6 Luna (high) on AutomationBench 1.0.6 (opens in a new tab)Task pass rateReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on AutomationBench 1.0.6
AutomationBench 1.0.6Effort: xHigh12.9%openai.com for GPT-5.6 Luna (xhigh) on AutomationBench 1.0.6 (opens in a new tab)Task pass rateReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on AutomationBench 1.0.6
AutomationBench 1.0.6Effort: Max17.0%openai.com for GPT-5.6 Luna (max) on AutomationBench 1.0.6 (opens in a new tab)Task pass rateReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on AutomationBench 1.0.6
AutomationBench 1.0.60.2%zapier.com for GPT-5.6 Luna on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.6 Luna on AutomationBench 1.0.6
BrowseComp 130-question subset — Mercor web research agentEffort: MaxConfiguration: Mercor web research agent, 100 steps, 3 hours83.8%mercor.com for GPT-5.6 Luna (max) on BrowseComp 130-question subset — Mercor web research agent (opens in a new tab)Archived copy (opens in a new tab)BrowseComp AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-5.6 Luna on BrowseComp 130-question subset — Mercor web research agent
BrowseComp83.3%openai.com for GPT-5.6 Luna on BrowseComp BrowseComp (opens in a new tab)BrowseComp AccuracyReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on BrowseComp BrowseComp
Chartography October 2026 leaderboardEffort: Max31.4%surgehq.ai for GPT-5.6 Luna (Max) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for GPT-5.6 Luna on Chartography October 2026 leaderboard
CharXiv Descriptive and reasoning — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent92.9%mercor.com for GPT-5.6 Luna (max) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)CharXiv AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-5.6 Luna on CharXiv Descriptive and reasoning — Mercor single-shot
CursorBench 4.0Effort: Low16.0%cursor.com for GPT-5.6 Luna (low) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for GPT-5.6 Luna on CursorBench 4.0
CursorBench 4.0Effort: Medium22.2%cursor.com for GPT-5.6 Luna (medium) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for GPT-5.6 Luna on CursorBench 4.0
CursorBench 4.0Effort: High29.4%cursor.com for GPT-5.6 Luna (high) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for GPT-5.6 Luna on CursorBench 4.0
CursorBench 4.0Effort: xHigh33.0%cursor.com for GPT-5.6 Luna (xhigh) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for GPT-5.6 Luna on CursorBench 4.0
CursorBench 4.0Effort: Max35.9%cursor.com for GPT-5.6 Luna (max) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for GPT-5.6 Luna on CursorBench 4.0
DeepSWE 1.1Effort: Low1.2%openai.com for GPT-5.6 Luna (low) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on DeepSWE 1.1
DeepSWE 1.1Effort: Medium9.3%openai.com for GPT-5.6 Luna (medium) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on DeepSWE 1.1
DeepSWE 1.1Effort: High42.4%openai.com for GPT-5.6 Luna (high) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on DeepSWE 1.1
DeepSWE 1.1Effort: xHigh56.2%openai.com for GPT-5.6 Luna (xhigh) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on DeepSWE 1.1
DeepSWE 1.1Effort: Max62.2%openai.com for GPT-5.6 Luna (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on DeepSWE 1.1
DeepSWE 1.1Effort: Max67.0%deepswe.datacurve.ai for GPT-5.6 Luna (max) on DeepSWE 1.1 (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for GPT-5.6 Luna on DeepSWE 1.1
DeepSWE 1.167.2%openai.com for GPT-5.6 Luna on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on DeepSWE 1.1
DeepSWE 1.1 — Mercor mini-swe-agent, 500 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 500 steps, 2 hours64.3%mercor.com for GPT-5.6 Luna (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for GPT-5.6 Luna on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps
Finance Agent Benchmark 2 — October 2026 evaluationEffort: Max55.0%vals.ai for GPT-5.6 Luna (max) on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Finance Agent AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.6 Luna on Finance Agent Benchmark 2 — October 2026 evaluation
GDP.pdf22.7%openai.com for GPT-5.6 Luna on GDP.pdf GDP.pdf (opens in a new tab)GDP.pdf All Pass RateReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on GDP.pdf GDP.pdf
GPQA Diamond92.3%openai.com for GPT-5.6 Luna on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on Graduate-Level Google-Proof Q&A Diamond
GPQA Diamond — Epoch AI harnessEffort: NoneConfiguration: Epoch AI harness63.6%epoch.ai for GPT-5.6 Luna (none) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.6 Luna on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Epoch AI harnessEffort: LowConfiguration: Epoch AI harness82.3%epoch.ai for GPT-5.6 Luna (low) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.6 Luna on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Epoch AI harnessEffort: MaxConfiguration: Epoch AI harness91.6%epoch.ai for GPT-5.6 Luna (max) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.6 Luna on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent91.8%mercor.com for GPT-5.6 Luna (max) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-5.6 Luna on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot
GPQA Diamond — Vals AI harnessEffort: MaxConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT91.7%vals.ai for GPT-5.6 Luna (max) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.6 Luna on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
HLAB October 2026 evaluationEffort: Max1.3%vals.ai for GPT-5.6 Luna (max) on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)HLAB Task Pass RateReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.6 Luna on Harvey's Legal Agent Benchmark October 2026 evaluation
Humanity's Last Exam Text only — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent39.6%mercor.com for GPT-5.6 Luna (max) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-5.6 Luna on Humanity's Last Exam Text only — Mercor single-shot
MedXpertQA MM — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent70.2%mercor.com for GPT-5.6 Luna (max) on MedXpertQA MM — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-5.6 Luna on MedXpertQA MM — Mercor single-shot
MMLU-Pro Original — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent86.5%mercor.com for GPT-5.6 Luna (max) on MMLU-Pro Original — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-5.6 Luna on MMLU-Pro Original — Mercor single-shot
MMLU-Pro Original — Vals AI harnessEffort: MaxConfiguration: Vals AI harness86.0%vals.ai for GPT-5.6 Luna (max) on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.6 Luna on MMLU-Pro Original — Vals AI harness
MMMU-Pro 1,730 questions — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent79.1%mercor.com for GPT-5.6 Luna (max) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Benchmark leaderboardMercorIndependentRecord for GPT-5.6 Luna on MMMU-Pro 1,730 questions — Mercor single-shot
MMMU-Pro No toolsConfiguration: No tools78.4%openai.com for GPT-5.6 Luna on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on MMMU-Pro No tools
MMMU-Pro Vals AI harnessEffort: MaxConfiguration: Vals AI harness85.0%vals.ai for GPT-5.6 Luna (max) on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for GPT-5.6 Luna on MMMU-Pro Vals AI harness
MMMU-Pro With toolsConfiguration: With tools79.5%openai.com for GPT-5.6 Luna on MMMU-Pro With tools (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on MMMU-Pro With tools
OSWorld 2.0 v2026.08.08 Offline — PartialEffort: Low12.0%openai.com for GPT-5.6 Luna (low) on OSWorld 2.0 v2026.08.08 Offline — Partial (opens in a new tab)OSWorld Partial ScoreReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on OSWorld 2.0 v2026.08.08 Offline — Partial
OSWorld 2.0 v2026.08.08 Offline — PartialEffort: Medium22.7%openai.com for GPT-5.6 Luna (medium) on OSWorld 2.0 v2026.08.08 Offline — Partial (opens in a new tab)OSWorld Partial ScoreReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on OSWorld 2.0 v2026.08.08 Offline — Partial
OSWorld 2.0 v2026.08.08 Offline — PartialEffort: High35.9%openai.com for GPT-5.6 Luna (high) on OSWorld 2.0 v2026.08.08 Offline — Partial (opens in a new tab)OSWorld Partial ScoreReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on OSWorld 2.0 v2026.08.08 Offline — Partial
OSWorld 2.0 v2026.08.08 Offline — PartialEffort: xHigh48.0%openai.com for GPT-5.6 Luna (xhigh) on OSWorld 2.0 v2026.08.08 Offline — Partial (opens in a new tab)OSWorld Partial ScoreReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on OSWorld 2.0 v2026.08.08 Offline — Partial
OSWorld 2.0 v2026.08.08 Offline — PartialEffort: Max52.7%openai.com for GPT-5.6 Luna (max) on OSWorld 2.0 v2026.08.08 Offline — Partial (opens in a new tab)OSWorld Partial ScoreReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Luna on OSWorld 2.0 v2026.08.08 Offline — Partial
SimpleQA Verified Original — Epoch AI harnessEffort: MaxConfiguration: Epoch AI harness41.0%epoch.ai for GPT-5.6 Luna (max) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.6 Luna on SimpleQA Verified Original — Epoch AI harness
SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 250 steps, 1 hour46.0%mercor.com for GPT-5.6 Luna (max) on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardMercorIndependentRecord for GPT-5.6 Luna on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
SWE-bench Multilingual — Mercor mini-swe-agent, 1000 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 1000 steps, 3 hours92.4%mercor.com for GPT-5.6 Luna (max) on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for GPT-5.6 Luna on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps
SWE-bench Verified — Mercor mini-swe-agent, 1000 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 1000 steps, 3 hours76.2%mercor.com for GPT-5.6 Luna (max) on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for GPT-5.6 Luna on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps