Benchmarks

55 results across 24 benchmarks

Benchmark results for GPT-5.6 Sol
BenchmarkScoreSource
AutomationBench 1.0.6Effort: Low11.7%openai.com for GPT-5.6 Sol (low) on AutomationBench 1.0.6 (opens in a new tab)Task pass rateReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on AutomationBench 1.0.6
AutomationBench 1.0.6Effort: Medium19.6%openai.com for GPT-5.6 Sol (medium) on AutomationBench 1.0.6 (opens in a new tab)Task pass rateReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on AutomationBench 1.0.6
AutomationBench 1.0.6Effort: High24.8%openai.com for GPT-5.6 Sol (high) on AutomationBench 1.0.6 (opens in a new tab)Task pass rateReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on AutomationBench 1.0.6
AutomationBench 1.0.6Effort: xHigh26.3%openai.com for GPT-5.6 Sol (xhigh) on AutomationBench 1.0.6 (opens in a new tab)Task pass rateReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on AutomationBench 1.0.6
AutomationBench 1.0.6Effort: Max28.8%openai.com for GPT-5.6 Sol (max) on AutomationBench 1.0.6 (opens in a new tab)Task pass rateReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on AutomationBench 1.0.6
AutomationBench 1.0.63.8%zapier.com for GPT-5.6 Sol on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.6 Sol on AutomationBench 1.0.6
BrowseComp 130-question subset — Mercor web research agentEffort: xHighConfiguration: Mercor web research agent, 100 steps, 3 hours90.6%mercor.com for GPT-5.6 Sol (xhigh) on BrowseComp 130-question subset — Mercor web research agent (opens in a new tab)Archived copy (opens in a new tab)BrowseComp AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-5.6 Sol on BrowseComp 130-question subset — Mercor web research agent
BrowseComp90.4%openai.com for GPT-5.6 Sol on BrowseComp BrowseComp (opens in a new tab)BrowseComp AccuracyReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on BrowseComp BrowseComp
Chartography October 2026 leaderboardEffort: Max45.0%surgehq.ai for GPT-5.6 Sol (Max) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for GPT-5.6 Sol on Chartography October 2026 leaderboard
CursorBench 4.0Effort: Low24.6%cursor.com for GPT-5.6 Sol (low) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for GPT-5.6 Sol on CursorBench 4.0
CursorBench 4.0Effort: Medium31.1%cursor.com for GPT-5.6 Sol (medium) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for GPT-5.6 Sol on CursorBench 4.0
CursorBench 4.0Effort: High35.7%cursor.com for GPT-5.6 Sol (high) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for GPT-5.6 Sol on CursorBench 4.0
CursorBench 4.0Effort: xHigh37.7%cursor.com for GPT-5.6 Sol (xhigh) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for GPT-5.6 Sol on CursorBench 4.0
CursorBench 4.0Effort: Max41.7%cursor.com for GPT-5.6 Sol (max) on CursorBench 4.0 (opens in a new tab)Archived copy (opens in a new tab)CursorBench AccuracyReported Benchmark leaderboardCursorIndependentRecord for GPT-5.6 Sol on CursorBench 4.0
DeepSWE 1.1Effort: Low45.4%openai.com for GPT-5.6 Sol (low) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on DeepSWE 1.1
DeepSWE 1.1Effort: Medium61.1%openai.com for GPT-5.6 Sol (medium) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on DeepSWE 1.1
DeepSWE 1.1Effort: High69.4%openai.com for GPT-5.6 Sol (high) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on DeepSWE 1.1
DeepSWE 1.1Effort: xHigh70.7%openai.com for GPT-5.6 Sol (xhigh) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on DeepSWE 1.1
DeepSWE 1.1Effort: Max73.0%deepswe.datacurve.ai for GPT-5.6 Sol (max) on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for GPT-5.6 Sol on DeepSWE 1.1
DeepSWE 1.172.7%openai.com for GPT-5.6 Sol on DeepSWE 1.1 (opens in a new tab)DeepSWE Pass@1Reported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on DeepSWE 1.1
DeepSWE 1.1 — Mercor mini-swe-agent, 500 stepsEffort: MaxConfiguration: Mercor mini-swe-agent, 500 steps, 2 hours70.5%mercor.com for GPT-5.6 Sol (max) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for GPT-5.6 Sol on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps
Finance Agent Benchmark 2 — October 2026 evaluationEffort: Max53.8%vals.ai for GPT-5.6 Sol (max) on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Finance Agent AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.6 Sol on Finance Agent Benchmark 2 — October 2026 evaluation
FrontierSWE 2 — October 2026 evaluationConfiguration: Proximus harness, 5 trials, 20-hour budget32.2%frontierswe.com for GPT-5.6 Sol on FrontierSWE 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)FrontierSWE ScoreReported Benchmark leaderboardProximalIndependentRecord for GPT-5.6 Sol on FrontierSWE 2 — October 2026 evaluation
GDP.pdf30.7%openai.com for GPT-5.6 Sol on GDP.pdf GDP.pdf (opens in a new tab)GDP.pdf All Pass RateReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on GDP.pdf GDP.pdf
GPQA Diamond94.6%openai.com for GPT-5.6 Sol on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on Graduate-Level Google-Proof Q&A Diamond
GPQA Diamond — Epoch AI harnessEffort: NoneConfiguration: Epoch AI harness82.8%epoch.ai for GPT-5.6 Sol (none) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.6 Sol on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Epoch AI harnessEffort: LowConfiguration: Epoch AI harness89.9%epoch.ai for GPT-5.6 Sol (low) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.6 Sol on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Epoch AI harnessEffort: MaxConfiguration: Epoch AI harness93.5%epoch.ai for GPT-5.6 Sol (max) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.6 Sol on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Vals AI harnessEffort: MaxConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT95.2%vals.ai for GPT-5.6 Sol (max) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.6 Sol on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
HLAB October 2026 evaluationEffort: Max2.5%vals.ai for GPT-5.6 Sol (max) on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)HLAB Task Pass RateReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.6 Sol on Harvey's Legal Agent Benchmark October 2026 evaluation
Humanity's Last Exam Text only — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent47.0%mercor.com for GPT-5.6 Sol (max) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-5.6 Sol on Humanity's Last Exam Text only — Mercor single-shot
MCP Atlas Public, April 2026 updateReported as: sol81.8%labs.scale.com for GPT-5.6 Sol (sol) on MCP Atlas Public, April 2026 update (opens in a new tab)Pass rateReported Benchmark leaderboardScale AIIndependentRecord for GPT-5.6 Sol on MCP Atlas Public, April 2026 update
MMLU-Pro Original — Vals AI harnessEffort: MaxConfiguration: Vals AI harness89.1%vals.ai for GPT-5.6 Sol (max) on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.6 Sol on MMLU-Pro Original — Vals AI harness
MMMU-Pro 1,730 questions — Mercor single-shotEffort: MaxConfiguration: Mercor single-shot agent83.6%mercor.com for GPT-5.6 Sol (max) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Benchmark leaderboardMercorIndependentRecord for GPT-5.6 Sol on MMMU-Pro 1,730 questions — Mercor single-shot
MMMU-Pro No toolsConfiguration: No tools83.0%openai.com for GPT-5.6 Sol on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on MMMU-Pro No tools
MMMU-Pro Vals AI harnessEffort: MaxConfiguration: Vals AI harness88.8%vals.ai for GPT-5.6 Sol (max) on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for GPT-5.6 Sol on MMMU-Pro Vals AI harness
MMMU-Pro With toolsConfiguration: With tools84.6%openai.com for GPT-5.6 Sol on MMMU-Pro With tools (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on MMMU-Pro With tools
OSWorld 2.0 v2026.08.08 Offline — PartialEffort: Low29.8%openai.com for GPT-5.6 Sol (low) on OSWorld 2.0 v2026.08.08 Offline — Partial (opens in a new tab)OSWorld Partial ScoreReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on OSWorld 2.0 v2026.08.08 Offline — Partial
OSWorld 2.0 v2026.08.08 Offline — PartialEffort: Medium49.7%openai.com for GPT-5.6 Sol (medium) on OSWorld 2.0 v2026.08.08 Offline — Partial (opens in a new tab)OSWorld Partial ScoreReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on OSWorld 2.0 v2026.08.08 Offline — Partial
OSWorld 2.0 v2026.08.08 Offline — PartialEffort: High56.5%openai.com for GPT-5.6 Sol (high) on OSWorld 2.0 v2026.08.08 Offline — Partial (opens in a new tab)OSWorld Partial ScoreReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on OSWorld 2.0 v2026.08.08 Offline — Partial
OSWorld 2.0 v2026.08.08 Offline — PartialEffort: xHigh60.9%openai.com for GPT-5.6 Sol (xhigh) on OSWorld 2.0 v2026.08.08 Offline — Partial (opens in a new tab)OSWorld Partial ScoreReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on OSWorld 2.0 v2026.08.08 Offline — Partial
OSWorld 2.0 v2026.08.08 Offline — PartialEffort: Max66.2%openai.com for GPT-5.6 Sol (max) on OSWorld 2.0 v2026.08.08 Offline — Partial (opens in a new tab)OSWorld Partial ScoreReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on OSWorld 2.0 v2026.08.08 Offline — Partial
PostTrainBench 1.1 — Codex CLIEffort: MaxConfiguration: Codex harness36.2%posttrainbench.com for GPT-5.6 Sol (Max) on PostTrainBench 1.1 — Codex CLI (opens in a new tab)Archived copy (opens in a new tab)PostTrainBench Weighted AggregateReported Benchmark leaderboardPostTrainBenchIndependentPostTrainBench TeamRecord for GPT-5.6 Sol on PostTrainBench 1.1 — Codex CLI
PostTrainBench 1.2 — Codex CLIEffort: MaxConfiguration: Codex harness31.0%posttrainbench.com for GPT-5.6 Sol (Max) on PostTrainBench 1.2 — Codex CLI (opens in a new tab)Archived copy (opens in a new tab)PostTrainBench Weighted AggregateReported Benchmark leaderboardPostTrainBenchIndependentPostTrainBench TeamRecord for GPT-5.6 Sol on PostTrainBench 1.2 — Codex CLI
Riemann-bench October 2026 leaderboardEffort: Max74.4%surgehq.ai for GPT-5.6 Sol (Max) on Riemann-bench October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Riemann-bench Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for GPT-5.6 Sol on Riemann-bench October 2026 leaderboard
SimpleQA Verified Original — Epoch AI harnessEffort: MaxConfiguration: Epoch AI harness69.7%epoch.ai for GPT-5.6 Sol (max) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.6 Sol on SimpleQA Verified Original — Epoch AI harness
SWE Atlas Codebase QnA — Public; CodexEffort: xHighConfiguration: Codex harness46.0%labs.scale.com for GPT-5.6 Sol (xHigh) on SWE Atlas Codebase QnA — Public; Codex (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for GPT-5.6 Sol on SWE Atlas Codebase QnA — Public; Codex
SWE-bench Verified — Vals AI mini-swe-agentEffort: MaxConfiguration: mini-swe-agent harness96.2%vals.ai for GPT-5.6 Sol (max) on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.6 Sol on SWE-bench Verified — Vals AI mini-swe-agent
Terminal-Bench 2.188.8%openai.com for GPT-5.6 Sol on Terminal-Bench 2.1 (opens in a new tab)Terminal-Bench AccuracyReported Launch postOpenAISelf-reportedRecord for GPT-5.6 Sol on Terminal-Bench 2.1
Terminal-Bench 2.1 — Vals AI Terminus 2Effort: MaxConfiguration: Terminus-2 harness85.8%vals.ai for GPT-5.6 Sol (max) on Terminal-Bench 2.1 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.6 Sol on Terminal-Bench 2.1 — Vals AI Terminus 2