Benchmarks

7 results across 5 benchmarks

Benchmark results for GPT-4.5 Preview
BenchmarkScoreSource
GPQA Diamond69.5%openai.com for GPT-4.5 Preview on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Launch postOpenAISelf-reportedRecord for GPT-4.5 Preview on Graduate-Level Google-Proof Q&A Diamond
GPQA Diamond — Epoch AI harnessConfiguration: Epoch AI harness68.7%epoch.ai for GPT-4.5 Preview on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-4.5 Preview on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
Humanity's Last Exam Full set — Scale AI evaluation5.4%labs.scale.com for GPT-4.5 Preview on Humanity's Last Exam Full set — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for GPT-4.5 Preview on Humanity's Last Exam Full set — Scale AI evaluation
Humanity's Last Exam Text only — Scale AI evaluation5.8%labs.scale.com for GPT-4.5 Preview on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for GPT-4.5 Preview on Humanity's Last Exam Text only — Scale AI evaluation
MMMU75.2%openai.com for GPT-4.5 Preview on Massive Multi-discipline Multimodal Understanding MMMU (opens in a new tab)MMMU AccuracyReported Launch postOpenAISelf-reportedRecord for GPT-4.5 Preview on Massive Multi-discipline Multimodal Understanding MMMU
MMLU90.8%openai.com for GPT-4.5 Preview on Massive Multitask Language Understanding MMLU (opens in a new tab)MMLU AccuracyReported Launch postOpenAISelf-reportedRecord for GPT-4.5 Preview on Massive Multitask Language Understanding MMLU
SWE-bench Verified38.0%openai.com for GPT-4.5 Preview on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postOpenAISelf-reportedRecord for GPT-4.5 Preview on SWE-bench Verified