LabsNVIDIA

NVIDIA

Track NVIDIA model scores across public AI benchmarks including GPQA Diamond, HLE, SWE-bench Verified, IFBench, and SciCode. Each result is shown one benchmark at a time, with source links and evaluation dates — no blended score or composite ranking. 3 models tracked, spanning NVIDIA Nemotron 3 and NVIDIA Nemotron 3.5.

3 models26 results nvidia.com

Models 3

NVIDIA Nemotron 3.5 Lightning 30B-A3B

NVIDIA Nemotron 3.5 · nemotron 3.5 lightning

2026-08-11

9 results

NVIDIA Nemotron 3 Ultra

NVIDIA Nemotron 3 · nemotron 3 ultra

2026-06-04

9 results

NVIDIA Nemotron 3 Super 120B-A12B

NVIDIA Nemotron 3 · n-3-super

2026-03-10

8 results

Progress by benchmark

Show progress on

NVIDIA Nemotron 3 Super 120B-A12B

Mar 10, 2026

79.23%

NVIDIA Nemotron 3 Ultra

Jun 4, 2026

87.0%+7.8

NVIDIA Nemotron 3.5 Lightning 30B-A3B

Aug 11, 2026

75.44%−11.6

Single benchmark only

This view shows GPQA Diamond (accuracy) only. Other benchmarks use different metrics and are not directly comparable.

Progress matrix

Model	SWE-bench Verified % resolved	Terminal-Bench 2.1 task success	DeepSWE % resolved	GPQA Diamond accuracy	LiveCodeBench Pro Codeforces Elo	Humanity's Last Exam accuracy	LiveBench score	SWE-bench Pro % resolved	Berkeley Function Calling Leaderboard accuracy	MMMU-Pro accuracy	LMArena source-defined rating	ARC-AGI-1 accuracy	ARC-AGI-2 accuracy	ARC-AGI-3 accuracy	FrontierMath accuracy	AIME (OTIS Mock) accuracy	SimpleQA Verified accuracy	GBA Eval overall score	WeirdML average accuracy	MCP Atlas pass rate	Remote Labor Index automation rate	Artificial Analysis Intelligence Index Index	Epoch Capabilities Index Index	Aider Polyglot % correct	SWE-rebench Resolved rate (pass@1)	MMLU-Pro accuracy	OSWorld task success rate	GAIA: A Benchmark for General AI Assistants accuracy	BrowseComp accuracy	τ²-bench (Telecom) pass^1	AIME 2026 accuracy	MathVista accuracy	Video-MME accuracy	GDPval Elo	LiveCodeBench Pass@1	METR Task-Completion Time Horizons 50% time horizon	SciCode accuracy	MMMU (Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark) accuracy	AA-Omniscience: Knowledge and Hallucination Benchmark AA-Omniscience Index	IFBench accuracy	MultiChallenge accuracy	OpenAI-MRCR v2 (Multi-Round Coreference Resolution) accuracy (mean SequenceMatcher similarity)	LongBench v2 accuracy	Global-MMLU accuracy	Video-MMMU accuracy	WebDev Arena Elo	Search Arena Elo	Arena-Hard-Auto v2.0 % win rate	EQ-Bench Creative Writing v3 Elo	Design Arena Elo	AILuminate AI Safety Benchmark Safety grade	MASK (Model Alignment between Statements and Knowledge) Honesty score	MCP-Universe Overall Success Rate	CharXiv accuracy	OCRBench v2 accuracy	ScreenSpot-Pro accuracy	FACTS Grounding Grounding accuracy	BigCodeBench calibrated Pass@1	SWE-bench Multilingual % resolved	SWE-bench Multimodal % resolved	SuperGPQA accuracy	EnigmaEval accuracy	ZeroBench accuracy	IMO-Bench accuracy	PutnamBench Problems solved	MathArena HMMT February 2026 accuracy	FrontierMath Tier 4 accuracy	Vectara Hallucination Leaderboard Hallucination Rate	Gray Swan Arena (Agent Red-Teaming / Indirect Prompt Injection) Attack Success Rate (ASR)	PolyMath: Evaluating Mathematical Reasoning in Multilingual Contexts Difficulty-Weighted Accuracy (DW-ACC)	Vibe Code Bench Overall accuracy	Online-Mind2Web Task success rate	WebArena Task success rate	GSO: Software Optimization Benchmark for SWE-Agents Opt@1	MultiNRC accuracy	Terminal-Bench 2.0 task success	Terminal-Bench 4.0 resolution rate	SWE-Marathon resolution rate (pass@1)	FrontierCode weighted score (Main)	FrontierSWE dominance score	ProgramBench almost-resolved rate	CursorBench score	PostTrainBench weighted average score
NVIDIA Nemotron 3 Super 120B-A12B NVIDIA Nemotron 3	60.47%	—	—	79.23%	—	18.26%	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	67.8%	90.00%	—	—	—	—	—	—	—	-42	71.5%	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	84.85%	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—
NVIDIA Nemotron 3 Ultra NVIDIA Nemotron 3	71.9%	56.4%	—	87.0%	—	26.7%	—	—	—	—	—	—	—	—	—	—	—	—	43.5%	—	—	—	—	—	—	—	—	—	44.4%	—	—	—	—	—	—	—	44.6%	—	—	81.7%	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	67.7%	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—
NVIDIA Nemotron 3.5 Lightning 30B-A3B NVIDIA Nemotron 3.5	51.56%	24.58%	—	75.44%	—	11.72%	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	81.94%	—	—	36.97%	—	—	—	—	—	—	—	32.60%	—	—	71.88%	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	39.33%	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—

Scores are not normalised across benchmarks. Each column uses its own metric. Compare columns independently.

NVIDIA

Models 3

Progress by benchmark

Progress matrix

Related pages