Benchmarks

14 results across 9 benchmarks

Benchmark results for GPT-4.1
BenchmarkScoreSource
GPQA Diamond66.3%openai.com for GPT-4.1 on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Launch postOpenAISelf-reportedRecord for GPT-4.1 on Graduate-Level Google-Proof Q&A Diamond
GPQA Diamond — Epoch AI harnessConfiguration: Epoch AI harness66.9%epoch.ai for GPT-4.1 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-4.1 on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Vals AI harnessEffort: HighConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT65.4%vals.ai for GPT-4.1 (high) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-4.1 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
Humanity's Last Exam Full set — Scale AI evaluation5.4%labs.scale.com for GPT-4.1 on Humanity's Last Exam Full set — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for GPT-4.1 on Humanity's Last Exam Full set — Scale AI evaluation
Humanity's Last Exam Text only — Scale AI evaluation5.0%labs.scale.com for GPT-4.1 on Humanity's Last Exam Text only — Scale AI evaluation (opens in a new tab)Archived copy (opens in a new tab)Humanity's Last Exam AccuracyReported Benchmark leaderboardScale AIIndependentRecord for GPT-4.1 on Humanity's Last Exam Text only — Scale AI evaluation
MMMU74.8%openai.com for GPT-4.1 on Massive Multi-discipline Multimodal Understanding MMMU (opens in a new tab)MMMU AccuracyReported Launch postOpenAISelf-reportedRecord for GPT-4.1 on Massive Multi-discipline Multimodal Understanding MMMU
MMLU90.2%openai.com for GPT-4.1 on Massive Multitask Language Understanding MMLU (opens in a new tab)MMLU AccuracyReported Launch postOpenAISelf-reportedRecord for GPT-4.1 on Massive Multitask Language Understanding MMLU
MMLU-Pro Original — Vals AI harnessEffort: HighConfiguration: Vals AI harness80.5%vals.ai for GPT-4.1 (high) on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-4.1 on MMLU-Pro Original — Vals AI harness
MMMU-Pro Vals AI harnessEffort: HighConfiguration: Vals AI harness72.4%vals.ai for GPT-4.1 (high) on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for GPT-4.1 on MMMU-Pro Vals AI harness
SimpleQA Verified Original — Epoch AI harnessConfiguration: Epoch AI harness31.1%epoch.ai for GPT-4.1 on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-4.1 on SimpleQA Verified Original — Epoch AI harness
SWE-bench Verified54.6%openai.com for GPT-4.1 on SWE-bench Verified (opens in a new tab)Resolved TasksReported Launch postOpenAISelf-reportedRecord for GPT-4.1 on SWE-bench Verified
SWE-bench Verified — Epoch AI harnessConfiguration: Epoch AI harness48.5%epoch.ai for GPT-4.1 on SWE-bench Verified — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-4.1 on SWE-bench Verified — Epoch AI harness
SWE-bench Verified — mini-swe-agentConfiguration: mini-swe-agent harness39.6%github.com for GPT-4.1 on SWE-bench Verified — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark repositorySWE-benchIndependentSWE-bench TeamRecord for GPT-4.1 on SWE-bench Verified — mini-swe-agent
Terminal-Bench 2.0 — Vals AI Terminus 2Effort: HighConfiguration: Terminus-2 harness14.6%vals.ai for GPT-4.1 (high) on Terminal-Bench 2.0 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-4.1 on Terminal-Bench 2.0 — Vals AI Terminus 2