Benchmarks

17 results across 8 benchmarks

Benchmark results for OpenAI o4-mini
BenchmarkScoreSource
GPQA Diamond — Epoch AI harnessEffort: LowConfiguration: Epoch AI harness75.3%epoch.ai for OpenAI o4-mini (low) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for OpenAI o4-mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Epoch AI harnessEffort: MediumConfiguration: Epoch AI harness77.8%epoch.ai for OpenAI o4-mini (medium) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for OpenAI o4-mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Epoch AI harnessEffort: HighConfiguration: Epoch AI harness79.6%epoch.ai for OpenAI o4-mini (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for OpenAI o4-mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Vals AI harnessEffort: HighConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT74.5%vals.ai for OpenAI o4-mini (high) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for OpenAI o4-mini on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
HealthBenchEffort: High50.1%deploymentsafety.openai.com for OpenAI o4-mini (high) on HealthBench HealthBench (opens in a new tab)HealthBench ScoreReported Model cardOpenAISelf-reportedRecord for OpenAI o4-mini on HealthBench HealthBench
HealthBench HealthBench ConsensusEffort: High91.8%deploymentsafety.openai.com for OpenAI o4-mini (high) on HealthBench HealthBench Consensus (opens in a new tab)HealthBench ScoreReported Model cardOpenAISelf-reportedRecord for OpenAI o4-mini on HealthBench HealthBench Consensus
HealthBench HealthBench HardEffort: High17.5%deploymentsafety.openai.com for OpenAI o4-mini (high) on HealthBench HealthBench Hard (opens in a new tab)HealthBench ScoreReported Model cardOpenAISelf-reportedRecord for OpenAI o4-mini on HealthBench HealthBench Hard
Humanity's Last Exam Full set — Scale AI evaluationEffort: Medium14.3%labs.scale.com for OpenAI o4-mini (medium) on Humanity's Last Exam Full set — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for OpenAI o4-mini on Humanity's Last Exam Full set — Scale AI evaluation
Humanity's Last Exam Full set — Scale AI evaluationEffort: High18.1%labs.scale.com for OpenAI o4-mini (high) on Humanity's Last Exam Full set — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for OpenAI o4-mini on Humanity's Last Exam Full set — Scale AI evaluation
Humanity's Last Exam Text only — Scale AI evaluationEffort: Medium14.5%labs.scale.com for OpenAI o4-mini (medium) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for OpenAI o4-mini on Humanity's Last Exam Text only — Scale AI evaluation
Humanity's Last Exam Text only — Scale AI evaluationEffort: High18.9%labs.scale.com for OpenAI o4-mini (high) on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for OpenAI o4-mini on Humanity's Last Exam Text only — Scale AI evaluation
MMLU-Pro Original — Vals AI harnessEffort: HighConfiguration: Vals AI harness80.6%vals.ai for OpenAI o4-mini (high) on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for OpenAI o4-mini on MMLU-Pro Original — Vals AI harness
MMMU-Pro Vals AI harnessEffort: HighConfiguration: Vals AI harness79.7%vals.ai for OpenAI o4-mini (high) on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for OpenAI o4-mini on MMMU-Pro Vals AI harness
SimpleQA Verified Original — Epoch AI harnessEffort: LowConfiguration: Epoch AI harness19.6%epoch.ai for OpenAI o4-mini (low) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for OpenAI o4-mini on SimpleQA Verified Original — Epoch AI harness
SimpleQA Verified Original — Epoch AI harnessEffort: HighConfiguration: Epoch AI harness18.8%epoch.ai for OpenAI o4-mini (high) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for OpenAI o4-mini on SimpleQA Verified Original — Epoch AI harness
SWE-bench Verified — mini-swe-agentConfiguration: mini-swe-agent harness45.0%github.com for OpenAI o4-mini on SWE-bench Verified — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark repositorySWE-benchIndependentSWE-bench TeamRecord for OpenAI o4-mini on SWE-bench Verified — mini-swe-agent
Toolathlon Original14.8%toolathlon.xyz for OpenAI o4-mini on Toolathlon Original (opens in a new tab)Archived copy (opens in a new tab)Tasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord for OpenAI o4-mini on Toolathlon Original