Benchmarks

5 results across 3 benchmarks

Benchmark results for NVIDIA Nemotron 3 Nano 30B-A3B
BenchmarkScoreSource
GPQA DiamondReported as: no-toolsConfiguration: No tools73.0%huggingface.co for NVIDIA Nemotron 3 Nano 30B-A3B (no-tools) on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Model cardNVIDIASelf-reportedRecord for NVIDIA Nemotron 3 Nano 30B-A3B on Graduate-Level Google-Proof Q&A Diamond
GPQA DiamondReported as: tools enabledConfiguration: With tools75.0%huggingface.co for NVIDIA Nemotron 3 Nano 30B-A3B (tools enabled) on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Model cardNVIDIASelf-reportedRecord for NVIDIA Nemotron 3 Nano 30B-A3B on Graduate-Level Google-Proof Q&A Diamond
Humanity's Last Exam Full set — No toolsReported as: no-toolsConfiguration: No tools10.6%huggingface.co for NVIDIA Nemotron 3 Nano 30B-A3B (no-tools) on Humanity's Last Exam Full set — No tools (opens in a new tab)Humanity's Last Exam AccuracyReported Model cardNVIDIASelf-reportedRecord for NVIDIA Nemotron 3 Nano 30B-A3B on Humanity's Last Exam Full set — No tools
Humanity's Last Exam Full set — With toolsReported as: tools enabledConfiguration: With tools15.5%huggingface.co for NVIDIA Nemotron 3 Nano 30B-A3B (tools enabled) on Humanity's Last Exam Full set — With tools (opens in a new tab)Humanity's Last Exam AccuracyReported Model cardNVIDIASelf-reportedRecord for NVIDIA Nemotron 3 Nano 30B-A3B on Humanity's Last Exam Full set — With tools
MMLU-Pro Original78.3%huggingface.co for NVIDIA Nemotron 3 Nano 30B-A3B on MMLU-Pro Original (opens in a new tab)AccuracyReported Model cardNVIDIASelf-reportedRecord for NVIDIA Nemotron 3 Nano 30B-A3B on MMLU-Pro Original