Nemotron 3 Ultra

Training compute

6.6×10²⁴ FLOP

Parameters

550B

Published

Jun 4, 2026

Nemotron 3 Ultra is an AI model developed by NVIDIA (United States), first published in June 2026. It works in the language domain, on tasks such as language modeling/generation and question answering.

Training it took an estimated 6.6×10²⁴ FLOP of compute. The model has 550,000,000,000 parameters.

Access: Open weights (unrestricted). Its weights are openly available. Epoch AI rates the confidence of this record as likely.

Full record

Organization: NVIDIA
Country of organization: United States
Domain: Language
Task: Language modeling/generation, Question answering
Training compute: 6.6×10²⁴ FLOP
Parameters: 550,000,000,000
Numerical format: NVFP4
Model accessibility: Open weights (unrestricted)
Open weights: Yes
Epoch confidence: Likely

Benchmark results

01	WeirdML	Accuracy	0.43
02	SciCode	Score	0.4
03	Apex Agents	Pass@1 score	0.12
04	Critpt	Accuracy	0.03
05	Proofbench	Accuracy	0.02