Benchmarks

13 results across 9 benchmarks

Benchmark results for GPT-5.4 nano
BenchmarkScoreSource
Finance Agent Benchmark 2 — October 2026 evaluationEffort: High38.2%vals.ai for GPT-5.4 nano (high) on Finance Agent Benchmark 2 — October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Finance Agent AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.4 nano on Finance Agent Benchmark 2 — October 2026 evaluation
GPQA Diamond — Epoch AI harnessEffort: NoneConfiguration: Epoch AI harness55.6%epoch.ai for GPT-5.4 nano (none) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.4 nano on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Epoch AI harnessEffort: LowConfiguration: Epoch AI harness72.2%epoch.ai for GPT-5.4 nano (low) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.4 nano on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Epoch AI harnessEffort: HighConfiguration: Epoch AI harness78.5%epoch.ai for GPT-5.4 nano (high) on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.4 nano on Graduate-Level Google-Proof Q&A Diamond — Epoch AI harness
GPQA Diamond — Vals AI harnessEffort: HighConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT77.5%vals.ai for GPT-5.4 nano (high) on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.4 nano on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
HLAB October 2026 evaluationEffort: High0.0%vals.ai for GPT-5.4 nano (high) on Harvey's Legal Agent Benchmark October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)HLAB Task Pass RateReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.4 nano on Harvey's Legal Agent Benchmark October 2026 evaluation
MMLU-Pro Original — Vals AI harnessEffort: HighConfiguration: Vals AI harness77.2%vals.ai for GPT-5.4 nano (high) on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.4 nano on MMLU-Pro Original — Vals AI harness
MMMU-Pro Vals AI harnessEffort: HighConfiguration: Vals AI harness73.6%vals.ai for GPT-5.4 nano (high) on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for GPT-5.4 nano on MMMU-Pro Vals AI harness
SimpleQA Verified Original — Epoch AI harnessEffort: HighConfiguration: Epoch AI harness11.7%epoch.ai for GPT-5.4 nano (high) on SimpleQA Verified Original — Epoch AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord for GPT-5.4 nano on SimpleQA Verified Original — Epoch AI harness
SWE-bench Verified — Vals AI mini-swe-agentEffort: HighConfiguration: mini-swe-agent harness69.8%vals.ai for GPT-5.4 nano (high) on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.4 nano on SWE-bench Verified — Vals AI mini-swe-agent
Terminal-Bench 2.0 — Vals AI Terminus 2Effort: HighConfiguration: Terminus-2 harness39.9%vals.ai for GPT-5.4 nano (high) on Terminal-Bench 2.0 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.4 nano on Terminal-Bench 2.0 — Vals AI Terminus 2
Terminal-Bench 2.1 — Vals AI Terminus 2Effort: HighConfiguration: Terminus-2 harness41.6%vals.ai for GPT-5.4 nano (high) on Terminal-Bench 2.1 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.4 nano on Terminal-Bench 2.1 — Vals AI Terminus 2
Vibe Code Bench 1.1 — OpenHands, October 2026 evaluationEffort: HighConfiguration: OpenHands harness26.1%vals.ai for GPT-5.4 nano (high) on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation (opens in a new tab)Archived copy (opens in a new tab)Vibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord for GPT-5.4 nano on Vibe Code Bench 1.1 — OpenHands, October 2026 evaluation