Benchmarks

40 results across 12 benchmarks

Benchmark results for gpt-oss-120b
BenchmarkScoreSource
APEX-Agents OriginalEffort: High4.4%mercor.com for gpt-oss-120b (high) on APEX-Agents Original (opens in a new tab)Archived copy (opens in a new tab)Pass rateReported Benchmark leaderboardMercorIndependentRecord for gpt-oss-120b on APEX-Agents Original
AutomationBench 1.0.6Effort: High0.2%zapier.com for gpt-oss-120b (high) on AutomationBench 1.0.6 (opens in a new tab)Archived copy (opens in a new tab)Task pass rateReported Benchmark leaderboardZapierIndependentZapier AutomationBench TeamRecord for gpt-oss-120b on AutomationBench 1.0.6
Codeforces No toolsEffort: LowConfiguration: No tools1595deploymentsafety.openai.com for gpt-oss-120b (low) on Codeforces No tools (opens in a new tab)Codeforces EloReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on Codeforces No tools
Codeforces No toolsEffort: MediumConfiguration: No tools2205deploymentsafety.openai.com for gpt-oss-120b (medium) on Codeforces No tools (opens in a new tab)Codeforces EloReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on Codeforces No tools
Codeforces No toolsEffort: HighConfiguration: No tools2463deploymentsafety.openai.com for gpt-oss-120b (high) on Codeforces No tools (opens in a new tab)Codeforces EloReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on Codeforces No tools
Codeforces With toolsEffort: LowConfiguration: With tools1653deploymentsafety.openai.com for gpt-oss-120b (low) on Codeforces With tools (opens in a new tab)Codeforces EloReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on Codeforces With tools
Codeforces With toolsEffort: MediumConfiguration: With tools2365deploymentsafety.openai.com for gpt-oss-120b (medium) on Codeforces With tools (opens in a new tab)Codeforces EloReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on Codeforces With tools
Codeforces With toolsEffort: HighConfiguration: With tools2622deploymentsafety.openai.com for gpt-oss-120b (high) on Codeforces With tools (opens in a new tab)Codeforces EloReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on Codeforces With tools
DeepSWE 1.1 — Mercor mini-swe-agent, 500 stepsEffort: HighConfiguration: Mercor mini-swe-agent, 500 steps, 2 hours0.0%mercor.com for gpt-oss-120b (high) on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps (opens in a new tab)Archived copy (opens in a new tab)DeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord for gpt-oss-120b on DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps
GPQA DiamondEffort: LowReported as: low (no tools)Configuration: No tools67.1%deploymentsafety.openai.com for gpt-oss-120b (low (no tools)) on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on Graduate-Level Google-Proof Q&A Diamond
GPQA DiamondEffort: LowReported as: low (with tools)Configuration: With tools68.1%deploymentsafety.openai.com for gpt-oss-120b (low (with tools)) on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on Graduate-Level Google-Proof Q&A Diamond
GPQA DiamondEffort: MediumReported as: medium (no tools)Configuration: No tools73.1%deploymentsafety.openai.com for gpt-oss-120b (medium (no tools)) on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on Graduate-Level Google-Proof Q&A Diamond
GPQA DiamondEffort: MediumReported as: medium (with tools)Configuration: With tools73.5%deploymentsafety.openai.com for gpt-oss-120b (medium (with tools)) on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on Graduate-Level Google-Proof Q&A Diamond
GPQA DiamondEffort: HighReported as: high (no tools)Configuration: No tools80.1%deploymentsafety.openai.com for gpt-oss-120b (high (no tools)) on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on Graduate-Level Google-Proof Q&A Diamond
GPQA DiamondEffort: HighReported as: high (with tools)Configuration: With tools80.9%deploymentsafety.openai.com for gpt-oss-120b (high (with tools)) on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on Graduate-Level Google-Proof Q&A Diamond
GPQA Diamond — Epoch AI harnessEffort: HighConfiguration: Epoch AI harness75.8%epoch.ai for gpt-oss-120b (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for gpt-oss-120b on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Mercor single-shotEffort: HighConfiguration: Mercor single-shot agent77.5%mercor.com for gpt-oss-120b (high) on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord for gpt-oss-120b on Graduate-Level Google-Proof Q&A Diamond — Mercor single-shot
GPQA Diamond — Vals AI harnessConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT78.5%vals.ai for gpt-oss-120b on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for gpt-oss-120b on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
HealthBenchEffort: Low53.0%deploymentsafety.openai.com for gpt-oss-120b (low) on HealthBench HealthBench (opens in a new tab)HealthBench ScoreReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on HealthBench HealthBench
HealthBenchEffort: Medium55.9%deploymentsafety.openai.com for gpt-oss-120b (medium) on HealthBench HealthBench (opens in a new tab)HealthBench ScoreReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on HealthBench HealthBench
HealthBenchEffort: High57.6%deploymentsafety.openai.com for gpt-oss-120b (high) on HealthBench HealthBench (opens in a new tab)HealthBench ScoreReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on HealthBench HealthBench
HealthBench HealthBench ConsensusEffort: Low90.6%deploymentsafety.openai.com for gpt-oss-120b (low) on HealthBench HealthBench Consensus (opens in a new tab)HealthBench ScoreReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on HealthBench HealthBench Consensus
HealthBench HealthBench ConsensusEffort: Medium90.8%deploymentsafety.openai.com for gpt-oss-120b (medium) on HealthBench HealthBench Consensus (opens in a new tab)HealthBench ScoreReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on HealthBench HealthBench Consensus
HealthBench HealthBench ConsensusEffort: High89.9%deploymentsafety.openai.com for gpt-oss-120b (high) on HealthBench HealthBench Consensus (opens in a new tab)HealthBench ScoreReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on HealthBench HealthBench Consensus
HealthBench HealthBench HardEffort: Low22.8%deploymentsafety.openai.com for gpt-oss-120b (low) on HealthBench HealthBench Hard (opens in a new tab)HealthBench ScoreReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on HealthBench HealthBench Hard
HealthBench HealthBench HardEffort: Medium26.9%deploymentsafety.openai.com for gpt-oss-120b (medium) on HealthBench HealthBench Hard (opens in a new tab)HealthBench ScoreReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on HealthBench HealthBench Hard
HealthBench HealthBench HardEffort: High30.0%deploymentsafety.openai.com for gpt-oss-120b (high) on HealthBench HealthBench Hard (opens in a new tab)HealthBench ScoreReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on HealthBench HealthBench Hard
Humanity's Last Exam Text only — Mercor single-shotEffort: HighConfiguration: Mercor single-shot agent18.5%mercor.com for gpt-oss-120b (high) on Humanity's Last Exam Text only — Mercor single-shot (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord for gpt-oss-120b on Humanity's Last Exam Text only — Mercor single-shot
Humanity's Last Exam Text only — Scale AI evaluation15.5%labs.scale.com for gpt-oss-120b on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for gpt-oss-120b on Humanity's Last Exam Text only — Scale AI evaluation
MMLUEffort: Low85.9%deploymentsafety.openai.com for gpt-oss-120b (low) on Massive Multitask Language Understanding MMLU (opens in a new tab)MMLU AccuracyReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on Massive Multitask Language Understanding MMLU
MMLUEffort: Medium88.0%deploymentsafety.openai.com for gpt-oss-120b (medium) on Massive Multitask Language Understanding MMLU (opens in a new tab)MMLU AccuracyReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on Massive Multitask Language Understanding MMLU
MMLUEffort: High90.0%deploymentsafety.openai.com for gpt-oss-120b (high) on Massive Multitask Language Understanding MMLU (opens in a new tab)MMLU AccuracyReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on Massive Multitask Language Understanding MMLU
MMLU-Pro Original — Vals AI harnessConfiguration: Vals AI harness79.2%vals.ai for gpt-oss-120b on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for gpt-oss-120b on MMLU-Pro Original — Vals AI harness
SWE-bench VerifiedEffort: Low47.9%deploymentsafety.openai.com for gpt-oss-120b (low) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on SWE-bench Verified
SWE-bench VerifiedEffort: Medium52.6%deploymentsafety.openai.com for gpt-oss-120b (medium) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on SWE-bench Verified
SWE-bench VerifiedEffort: High62.4%deploymentsafety.openai.com for gpt-oss-120b (high) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model cardOpenAISelf-reportedRecord for gpt-oss-120b on SWE-bench Verified
SWE-bench Verified — mini-swe-agentConfiguration: mini-swe-agent harness26.0%github.com for gpt-oss-120b on SWE-bench Verified — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark repositorySWE-benchIndependentSWE-bench TeamRecord for gpt-oss-120b on SWE-bench Verified — mini-swe-agent
SWE-bench Verified — Vals AI mini-swe-agentConfiguration: mini-swe-agent harness33.6%vals.ai for gpt-oss-120b on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardVals AIIndependentRecord for gpt-oss-120b on SWE-bench Verified — Vals AI mini-swe-agent
SWE-bench Pro Public — Scale AI SWE-AgentConfiguration: SWE-Agent harness, 250 turns, uncapped cost16.2%labs.scale.com for gpt-oss-120b on SWE-bench Pro Public — Scale AI SWE-Agent (opens in a new tab)Archived copy (opens in a new tab)Public tasks resolvedReported Benchmark leaderboardScale AIIndependentRecord for gpt-oss-120b on SWE-bench Pro Public — Scale AI SWE-Agent
Terminal-Bench 2.0 — Vals AI Terminus 2Configuration: Terminus-2 harness19.1%vals.ai for gpt-oss-120b on Terminal-Bench 2.0 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for gpt-oss-120b on Terminal-Bench 2.0 — Vals AI Terminus 2