Benchmarks

6 results across 5 benchmarks

Benchmark results for GPT-4.1 mini
BenchmarkScoreSource
GPQA Diamond — Epoch AI harnessConfiguration: Epoch AI harness65.8%epoch.ai for GPT-4.1 mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-4.1 mini on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Vals AI harnessEffort: HighConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT67.9%vals.ai for GPT-4.1 mini (high) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-4.1 mini on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
MMLU-Pro Original — Vals AI harnessEffort: HighConfiguration: Vals AI harness77.2%vals.ai for GPT-4.1 mini (high) on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-4.1 mini on MMLU-Pro Original — Vals AI harness
MMMU-Pro Vals AI harnessEffort: HighConfiguration: Vals AI harness70.5%vals.ai for GPT-4.1 mini (high) on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for GPT-4.1 mini on MMMU-Pro Vals AI harness
SimpleQA Verified Original — Epoch AI harnessConfiguration: Epoch AI harness12.7%epoch.ai for GPT-4.1 mini on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-4.1 mini on SimpleQA Verified Original — Epoch AI harness
SWE-bench Verified — mini-swe-agentConfiguration: mini-swe-agent harness23.9%github.com for GPT-4.1 mini on SWE-bench Verified — mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark repositorySWE-benchIndependentSWE-bench TeamRecord for GPT-4.1 mini on SWE-bench Verified — mini-swe-agent