Benchmarks

51 results across 25 benchmarks

Benchmark results for GPT-5.5
BenchmarkScoreSource
APEX-Agents OriginalEffort: xHigh55.1%mercor.com for GPT-5.5 (xhigh) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for GPT-5.5 on APEX-Agents Original
AutomationBench 1.0.6Effort: Low2.6%zapier.com for GPT-5.5 (low) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.5 on AutomationBench 1.0.6
AutomationBench 1.0.6Effort: Medium9.0%zapier.com for GPT-5.5 (medium) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.5 on AutomationBench 1.0.6
AutomationBench 1.0.6Effort: High12.8%zapier.com for GPT-5.5 (high) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.5 on AutomationBench 1.0.6
AutomationBench 1.0.6Effort: xHigh16.6%zapier.com for GPT-5.5 (xhigh) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.5 on AutomationBench 1.0.6
AutomationBench 1.0.61.1%zapier.com for GPT-5.5 on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for GPT-5.5 on AutomationBench 1.0.6
BrowseComp 130-question subset — Mercor web research agentEffort: xHighConfiguration: Mercor web research agent, 100 steps, 3 hours77.7%mercor.com for GPT-5.5 (xhigh) on BrowseComp 130-question subset — Mercor web research agent (opens in a new tab)Archived copy (opens in a new tab)BrowseComp AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-5.5 on BrowseComp 130-question subset — Mercor web research agent
BrowseCompEffort: xHigh84.4%openai.com for GPT-5.5 (xhigh) on BrowseComp BrowseComp (opens in a new tab)BrowseComp AccuracyReported Launch postOpenAISelf-reportedRecord for GPT-5.5 on BrowseComp BrowseComp
Chartography October 2026 leaderboardEffort: xHigh31.0%surgehq.ai for GPT-5.5 (xHigh) on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for GPT-5.5 on Chartography October 2026 leaderboard
CharXiv Descriptive and reasoning — Mercor single-shotEffort: xHighConfiguration: Mercor single-shot agent94.6%mercor.com for GPT-5.5 (xhigh) on CharXiv Descriptive and reasoning — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)CharXiv AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-5.5 on CharXiv Descriptive and reasoning — Mercor single-shot
DeepSWE 1.1Effort: xHigh67.0%deepswe.datacurve.ai for GPT-5.5 (xhigh) on DeepSWE 1.1 (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardDatacurveIndependentRecord for GPT-5.5 on DeepSWE 1.1
DeepSWE 1.1 — Mercor mini-swe-agent, 500 stepsEffort: xHighConfiguration: Mercor mini-swe-agent, 500 steps, 2 hours66.1%mercor.com for GPT-5.5 (xhigh) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for GPT-5.5 on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps
Finance Agent Benchmark 2 — October 2026 evaluationEffort: xHigh51.8%vals.ai for GPT-5.5 (xhigh) on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Finance Agent AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.5 on Finance Agent Benchmark 2 — October 2026 evaluation
GDPvalEffort: xHigh84.9%openai.com for GPT-5.5 (xhigh) on GDPval GDPval (opens in a new tab)Wins or tiesReported Launch postOpenAISelf-reportedRecord for GPT-5.5 on GDPval GDPval
GPQA DiamondEffort: xHigh93.6%openai.com for GPT-5.5 (xhigh) on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Launch postOpenAISelf-reportedRecord for GPT-5.5 on Graduate-Level Google-Proof Q&A Diamond
GPQA Diamond — Epoch AI harnessEffort: NoneConfiguration: Epoch AI harness77.3%epoch.ai for GPT-5.5 (none) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Epoch AI harnessEffort: LowConfiguration: Epoch AI harness90.7%epoch.ai for GPT-5.5 (low) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.5 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Mercor single-shotEffort: xHighConfiguration: Mercor single-shot agent94.6%mercor.com for GPT-5.5 (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-5.5 on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot
GPQA Diamond — Vals AI harnessEffort: xHighConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT93.2%vals.ai for GPT-5.5 (xhigh) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.5 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
HLAB October 2026 evaluationEffort: xHigh3.8%vals.ai for GPT-5.5 (xhigh) on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)HLAB Task Pass RateReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.5 on Harvey's Legal Agent Benchmark October 2026 evaluation
Humanity's Last Exam Full set — No toolsEffort: xHighConfiguration: No tools41.4%openai.com for GPT-5.5 (xhigh) on Humanity's Last Exam Full set — No tools (opens in a new tab)Humanity's Last Exam AccuracyReported Launch postOpenAISelf-reportedRecord for GPT-5.5 on Humanity's Last Exam Full set — No tools
Humanity's Last Exam Full set — With toolsEffort: xHighConfiguration: With tools52.2%openai.com for GPT-5.5 (xhigh) on Humanity's Last Exam Full set — With tools (opens in a new tab)Humanity's Last Exam AccuracyReported Launch postOpenAISelf-reportedRecord for GPT-5.5 on Humanity's Last Exam Full set — With tools
Humanity's Last Exam Text only — Mercor single-shotEffort: xHighConfiguration: Mercor single-shot agent46.5%mercor.com for GPT-5.5 (xhigh) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-5.5 on Humanity's Last Exam Text only — Mercor single-shot
MCP Atlas Public, April 2026 updateEffort: xHigh75.3%labs.scale.com for GPT-5.5 (xhigh) on MCP Atlas Public, April 2026 update (opens in a new tab)Pass rateReported Benchmark leaderboardScale AIIndependentRecord for GPT-5.5 on MCP Atlas Public, April 2026 update
MedXpertQA MM — Mercor single-shotEffort: xHighConfiguration: Mercor single-shot agent76.7%mercor.com for GPT-5.5 (xhigh) on MedXpertQA MM — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-5.5 on MedXpertQA MM — Mercor single-shot
MMLU-Pro Original — Mercor single-shotEffort: xHighConfiguration: Mercor single-shot agent88.9%mercor.com for GPT-5.5 (xhigh) on MMLU-Pro Original — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-5.5 on MMLU-Pro Original — Mercor single-shot
MMLU-Pro Original — Vals AI harnessEffort: xHighConfiguration: Vals AI harness88.1%vals.ai for GPT-5.5 (xhigh) on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.5 on MMLU-Pro Original — Vals AI harness
MMMU-Pro 1,730 questions — Mercor single-shotEffort: xHighConfiguration: Mercor single-shot agent81.8%mercor.com for GPT-5.5 (xhigh) on MMMU-Pro 1,730 questions — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Benchmark leaderboardMercorIndependentRecord for GPT-5.5 on MMMU-Pro 1,730 questions — Mercor single-shot
MMMU-Pro No toolsEffort: xHighConfiguration: No tools81.2%openai.com for GPT-5.5 (xhigh) on MMMU-Pro No tools (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Launch postOpenAISelf-reportedRecord for GPT-5.5 on MMMU-Pro No tools
MMMU-Pro Vals AI harnessEffort: xHighConfiguration: Vals AI harness88.3%vals.ai for GPT-5.5 (xhigh) on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for GPT-5.5 on MMMU-Pro Vals AI harness
MMMU-Pro With toolsEffort: xHighConfiguration: With tools83.2%openai.com for GPT-5.5 (xhigh) on MMMU-Pro With tools (opens in a new tab)MMMU-Pro accuracySetting: Not statedReported Launch postOpenAISelf-reportedRecord for GPT-5.5 on MMMU-Pro With tools
OSWorld VerifiedEffort: xHigh78.7%openai.com for GPT-5.5 (xhigh) on OSWorld Verified (opens in a new tab)OSWorld-Verified success rateReported Launch postOpenAISelf-reportedRecord for GPT-5.5 on OSWorld Verified
PostTrainBench 1.1 — Codex CLIEffort: xHighConfiguration: Codex harness27.2%posttrainbench.com for GPT-5.5 (xHigh) on PostTrainBench 1.1 — Codex CLI (opens in a new tab)Archived copy (opens in a new tab)PostTrainBench Weighted AggregateReported Benchmark leaderboardPostTrainBenchIndependentPostTrainBench TeamRecord for GPT-5.5 on PostTrainBench 1.1 — Codex CLI
PostTrainBench 1.2 — Codex CLIEffort: xHighConfiguration: Codex harness23.9%posttrainbench.com for GPT-5.5 (xHigh) on PostTrainBench 1.2 — Codex CLI (opens in a new tab)Archived copy (opens in a new tab)PostTrainBench Weighted AggregateReported Benchmark leaderboardPostTrainBenchIndependentPostTrainBench TeamRecord for GPT-5.5 on PostTrainBench 1.2 — Codex CLI
Riemann-bench October 2026 leaderboardEffort: xHigh55.2%surgehq.ai for GPT-5.5 (xHigh) on Riemann-bench October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Riemann-bench Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for GPT-5.5 on Riemann-bench October 2026 leaderboard
SimpleQA Verified Original — Epoch AI harnessEffort: xHighConfiguration: Epoch AI harness63.0%epoch.ai for GPT-5.5 (xhigh) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.5 on SimpleQA Verified Original — Epoch AI harness
SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 stepsEffort: xHighConfiguration: Mercor mini-swe-agent, 250 steps, 1 hour45.2%mercor.com for GPT-5.5 (xhigh) on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardMercorIndependentRecord for GPT-5.5 on SWE Atlas Codebase QnA — Mercor mini-swe-agent, 250 steps
SWE Atlas Codebase QnA — Public; CodexEffort: xHighConfiguration: Codex harness45.4%labs.scale.com for GPT-5.5 (xHigh) on SWE Atlas Codebase QnA — Public; Codex (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for GPT-5.5 on SWE Atlas Codebase QnA — Public; Codex
SWE Atlas Refactoring — CodexEffort: xHighConfiguration: Codex harness44.8%labs.scale.com for GPT-5.5 (xHigh) on SWE Atlas Refactoring — Codex (opens in a new tab)Archived copy (opens in a new tab)Mean pass@1Reported Benchmark leaderboardScale AIIndependentRecord for GPT-5.5 on SWE Atlas Refactoring — Codex
SWE-bench Multilingual — Mercor mini-swe-agent, 1000 stepsEffort: xHighConfiguration: Mercor mini-swe-agent, 1000 steps, 3 hours77.7%mercor.com for GPT-5.5 (xhigh) on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for GPT-5.5 on SWE-bench Multilingual — Mercor mini-swe-agent, 1000 steps
SWE-bench Verified — Mercor mini-swe-agent, 1000 stepsEffort: xHighConfiguration: Mercor mini-swe-agent, 1000 steps, 3 hours78.8%mercor.com for GPT-5.5 (xhigh) on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardMercorIndependentRecord for GPT-5.5 on SWE-bench Verified — Mercor mini-swe-agent, 1000 steps
SWE-bench Verified — Vals AI mini-swe-agentEffort: xHighConfiguration: mini-swe-agent harness82.6%vals.ai for GPT-5.5 (xhigh) on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.5 on SWE-bench Verified — Vals AI mini-swe-agent
Terminal-Bench 2.0Effort: xHigh82.7%openai.com for GPT-5.5 (xhigh) on Terminal-Bench 2.0 (opens in a new tab)Terminal-Bench AccuracyReported Launch postOpenAISelf-reportedRecord for GPT-5.5 on Terminal-Bench 2.0
Terminal-Bench 2.0 — Vals AI Terminus 2Effort: HighConfiguration: Terminus-2 harness73.2%vals.ai for GPT-5.5 (high) on Terminal-Bench 2.0 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.5 on Terminal-Bench 2.0 — Vals AI Terminus 2
Terminal-Bench 2.1 — Mercor Terminus 2Effort: xHighConfiguration: Mercor Terminus 2, 1000 steps, 3 hours83.1%mercor.com for GPT-5.5 (xhigh) on Terminal-Bench 2.1 — Mercor Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord for GPT-5.5 on Terminal-Bench 2.1 — Mercor Terminus 2
Terminal-Bench 2.1 — Vals AI Terminus 2Effort: HighConfiguration: Terminus-2 harness76.4%vals.ai for GPT-5.5 (high) on Terminal-Bench 2.1 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.5 on Terminal-Bench 2.1 — Vals AI Terminus 2
Toolathlon VerifiedEffort: xHigh73.5%toolathlon.xyz for GPT-5.5 (xhigh) on Toolathlon Verified (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for GPT-5.5 on Toolathlon Verified
Vibe Code Bench 1.1 — Codex, October 2026 evaluationConfiguration: Codex harness58.2%vals.ai for GPT-5.5 on Vibe Code Bench 1.1 — Codex, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.5 on Vibe Code Bench 1.1 — Codex, October 2026 evaluation
Vibe Code Bench 1.1 — Factory, October 2026 evaluationConfiguration: Factory harness67.4%vals.ai for GPT-5.5 on Vibe Code Bench 1.1 — Factory, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.5 on Vibe Code Bench 1.1 — Factory, October 2026 evaluation
Vibe Code Bench 1.1 — OpenHands, October 2026 evaluationEffort: xHighConfiguration: OpenHands harness69.8%vals.ai for GPT-5.5 (xhigh) on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.5 on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation