Benchmark Registry

NVIDIA

Benchmark results for 3 NVIDIA models from official publications. Updated 2026-10-07.

Established
Not available
Latest model
NVIDIA Nemotron 3 Ultra 550B-A55B (June 2026)

Benchmarks

36 results

ModelBenchmarkScoreSourceRegistry No.
NVIDIA Nemotron 3 Ultra 550B-A55B (high)GPQA Diamond — Mercor single-shot87.8%mercor.comArchived copyGPQA Diamond AccuracyReported Benchmark leaderboardMercorIndependentRecord60003
NVIDIA Nemotron 3 Ultra 550B-A55B (high)MMLU-Pro Original — Mercor single-shot86.0%mercor.comArchived copyAccuracyReported Benchmark leaderboardMercorIndependentRecord60003
NVIDIA Nemotron 3 Ultra 550B-A55B (high)DeepSWE 1.1 — Mercor mini-swe-agent, 500 steps0.6%mercor.comArchived copyDeepSWE Pass@1Reported Benchmark leaderboardMercorIndependentRecord60003
NVIDIA Nemotron 3 Ultra 550B-A55B (high)Terminal-Bench 4.0 — Mercor mini-swe-agent0.0%mercor.comArchived copyTerminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord60003
NVIDIA Nemotron 3 Ultra 550B-A55B (high)Terminal-Bench 2.1 — Mercor Terminus 249.8%mercor.comArchived copyTerminal-Bench AccuracyReported Benchmark leaderboardMercorIndependentRecord60003
NVIDIA Nemotron 3 Ultra 550B-A55B (high)Humanity's Last Exam Text only — Mercor single-shot28.1%mercor.comArchived copyHumanity's Last Exam AccuracyReported Benchmark leaderboardMercorIndependentRecord60003
NVIDIA Nemotron 3 Ultra 550B-A55BGPQA Diamond — Epoch AI harness85.4%epoch.aiArchived copyGPQA Diamond AccuracyReported Evaluated Benchmark leaderboardEpoch AIIndependentRecord60003
NVIDIA Nemotron 3 Ultra 550B-A55B (high)APEX-Agents Original22.7%mercor.comArchived copyPass rateReported Benchmark leaderboardMercorIndependentRecord60003
NVIDIA Nemotron 3 Ultra 550B-A55BFinance Agent Benchmark 2 — October 2026 evaluation37.7%vals.aiArchived copyFinance Agent AccuracyReported Benchmark leaderboardVals AIIndependentRecord60003
NVIDIA Nemotron 3 Ultra 550B-A55BVibe Code Bench 1.1 — OpenHands, October 2026 evaluation7.6%vals.aiArchived copyVibe Code Bench ScoreReported Benchmark leaderboardVals AIIndependentRecord60003
NVIDIA Nemotron 3 Ultra 550B-A55BHLAB October 2026 evaluation0.4%vals.aiArchived copyHLAB Task Pass RateReported Benchmark leaderboardVals AIIndependentRecord60003
NVIDIA Nemotron 3 Ultra 550B-A55BTerminal-Bench 2.1 — Vals AI Terminus 250.9%vals.aiArchived copyTerminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord60003
NVIDIA Nemotron 3 Ultra 550B-A55B (thinking)MCP Atlas Public, April 2026 update63.1%labs.scale.comPass rateReported Benchmark leaderboardScale AIIndependentRecord60003
NVIDIA Nemotron 3 Ultra 550B-A55BMMLU-Pro Original — Vals AI harness85.8%vals.aiArchived copyAccuracyReported Benchmark leaderboardVals AIIndependentRecord60003
NVIDIA Nemotron 3 Ultra 550B-A55BGPQA Diamond — Vals AI harness86.1%vals.aiArchived copyGPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord60003
NVIDIA Nemotron 3 Ultra 550B-A55BSWE-bench Verified — Vals AI mini-swe-agent69.0%vals.aiArchived copyResolved TasksReported Benchmark leaderboardVals AIIndependentRecord60003
NVIDIA Nemotron 3 Ultra 550B-A55BToolathlon Verified34.3%toolathlon.xyzArchived copyTasks completedReported Benchmark leaderboardToolathlonIndependentToolathlon AuthorsRecord60003
NVIDIA Nemotron 3 Ultra 550B-A55B (no-tools)Humanity's Last Exam Full set — No tools26.7%huggingface.coHumanity's Last Exam AccuracyReported Model cardNVIDIASelf-reportedRecord60003
NVIDIA Nemotron 3 Ultra 550B-A55BTerminal-Bench 2.156.4%huggingface.coTerminal-Bench AccuracyReported Model cardNVIDIASelf-reportedRecord60003
NVIDIA Nemotron 3 Ultra 550B-A55BBrowseComp44.4%huggingface.coBrowseComp AccuracyReported Model cardNVIDIASelf-reportedRecord60003
NVIDIA Nemotron 3 Ultra 550B-A55B (no-tools)GPQA Diamond87.0%huggingface.coGPQA Diamond AccuracyReported Model cardNVIDIASelf-reportedRecord60003
NVIDIA Nemotron 3 Ultra 550B-A55BSWE-bench Multilingual67.7%huggingface.coResolved TasksReported Model cardNVIDIASelf-reportedRecord60003
NVIDIA Nemotron 3 Ultra 550B-A55BSWE-bench Verified70.7%huggingface.coResolved TasksReported Model cardNVIDIASelf-reportedRecord60003
NVIDIA Nemotron 3 Super 120B-A12B (tools enabled)Humanity's Last Exam Full set — With tools22.8%huggingface.coHumanity's Last Exam AccuracyReported Model cardNVIDIASelf-reportedRecord60002
NVIDIA Nemotron 3 Super 120B-A12B (OpenHands)SWE-bench Verified60.5%huggingface.coResolved TasksReported Model cardNVIDIASelf-reportedRecord60002
NVIDIA Nemotron 3 Super 120B-A12B (no-tools)Humanity's Last Exam Full set — No tools18.3%huggingface.coHumanity's Last Exam AccuracyReported Model cardNVIDIASelf-reportedRecord60002
NVIDIA Nemotron 3 Super 120B-A12B (no-tools)GPQA Diamond79.2%huggingface.coGPQA Diamond AccuracyReported Model cardNVIDIASelf-reportedRecord60002
NVIDIA Nemotron 3 Super 120B-A12BMMLU-Pro Original83.7%huggingface.coAccuracyReported Model cardNVIDIASelf-reportedRecord60002
NVIDIA Nemotron 3 Super 120B-A12B (tools enabled)GPQA Diamond82.7%huggingface.coGPQA Diamond AccuracyReported Model cardNVIDIASelf-reportedRecord60002
NVIDIA Nemotron 3 Super 120B-A12B (OpenHands)SWE-bench Multilingual45.8%huggingface.coResolved TasksReported Model cardNVIDIASelf-reportedRecord60002
NVIDIA Nemotron 3 Super 120B-A12BTerminal-Bench 2.031.0%huggingface.coTerminal-Bench AccuracyReported Model cardNVIDIASelf-reportedRecord60002
NVIDIA Nemotron 3 Nano 30B-A3B (tools enabled)Humanity's Last Exam Full set — With tools15.5%huggingface.coHumanity's Last Exam AccuracyReported Model cardNVIDIASelf-reportedRecord60001
NVIDIA Nemotron 3 Nano 30B-A3B (no-tools)Humanity's Last Exam Full set — No tools10.6%huggingface.coHumanity's Last Exam AccuracyReported Model cardNVIDIASelf-reportedRecord60001
NVIDIA Nemotron 3 Nano 30B-A3BMMLU-Pro Original78.3%huggingface.coAccuracyReported Model cardNVIDIASelf-reportedRecord60001
NVIDIA Nemotron 3 Nano 30B-A3B (no-tools)GPQA Diamond73.0%huggingface.coGPQA Diamond AccuracyReported Model cardNVIDIASelf-reportedRecord60001
NVIDIA Nemotron 3 Nano 30B-A3B (tools enabled)GPQA Diamond75.0%huggingface.coGPQA Diamond AccuracyReported Model cardNVIDIASelf-reportedRecord60001

NVIDIA models