Benchmarks

8 results across 5 benchmarks

Benchmark results for NVIDIA Nemotron 3 Super 120B-A12B
BenchmarkScoreSource
GPQA DiamondReported as: no-toolsConfiguration: No tools79.2%huggingface.co for NVIDIA Nemotron 3 Super 120B-A12B (no-tools) on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Model cardNVIDIASelf-reportedRecord for NVIDIA Nemotron 3 Super 120B-A12B on Graduate-Level Google-Proof Q&A Diamond
GPQA DiamondReported as: tools enabledConfiguration: With tools82.7%huggingface.co for NVIDIA Nemotron 3 Super 120B-A12B (tools enabled) on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Model cardNVIDIASelf-reportedRecord for NVIDIA Nemotron 3 Super 120B-A12B on Graduate-Level Google-Proof Q&A Diamond
Humanity's Last Exam Full set — No toolsReported as: no-toolsConfiguration: No tools18.3%huggingface.co for NVIDIA Nemotron 3 Super 120B-A12B (no-tools) on Humanity's Last Exam Full set — No tools (opens in a new tab)Humanity's Last Exam AccuracyReported Model cardNVIDIASelf-reportedRecord for NVIDIA Nemotron 3 Super 120B-A12B on Humanity's Last Exam Full set — No tools
Humanity's Last Exam Full set — With toolsReported as: tools enabledConfiguration: With tools22.8%huggingface.co for NVIDIA Nemotron 3 Super 120B-A12B (tools enabled) on Humanity's Last Exam Full set — With tools (opens in a new tab)Humanity's Last Exam AccuracyReported Model cardNVIDIASelf-reportedRecord for NVIDIA Nemotron 3 Super 120B-A12B on Humanity's Last Exam Full set — With tools
MMLU-Pro Original83.7%huggingface.co for NVIDIA Nemotron 3 Super 120B-A12B on MMLU-Pro Original (opens in a new tab)AccuracyReported Model cardNVIDIASelf-reportedRecord for NVIDIA Nemotron 3 Super 120B-A12B on MMLU-Pro Original
SWE-bench MultilingualReported as: OpenHandsConfiguration: OpenHands harness45.8%huggingface.co for NVIDIA Nemotron 3 Super 120B-A12B (OpenHands) on SWE-bench Multilingual (opens in a new tab)Resolved TasksReported Model cardNVIDIASelf-reportedRecord for NVIDIA Nemotron 3 Super 120B-A12B on SWE-bench Multilingual
SWE-bench VerifiedReported as: OpenHandsConfiguration: OpenHands harness60.5%huggingface.co for NVIDIA Nemotron 3 Super 120B-A12B (OpenHands) on SWE-bench Verified (opens in a new tab)Resolved TasksReported Model cardNVIDIASelf-reportedRecord for NVIDIA Nemotron 3 Super 120B-A12B on SWE-bench Verified
Terminal-Bench 2.031.0%huggingface.co for NVIDIA Nemotron 3 Super 120B-A12B on Terminal-Bench 2.0 (opens in a new tab)Terminal-Bench AccuracyReported Model cardNVIDIASelf-reportedRecord for NVIDIA Nemotron 3 Super 120B-A12B on Terminal-Bench 2.0