Live
Head to head

Grok 3 vs Nemotron-4 340B

xAI
Grok 3
February 2025
vs
NVIDIA
Nemotron-4 340B
June 2024
3.5×10²⁶Training compute (FLOP)1.8×10²⁵
$218MTraining cost$21M

Grok 3 (xAI) and Nemotron-4 340B (NVIDIA) are both frontier AI models. Grok 3 was published in February 2025 and Nemotron-4 340B in June 2024.

Grok 3 was trained on 3.5×10²⁶ FLOP, about 19.4x the compute of Nemotron-4 340B at 1.8×10²⁵ FLOP. Training compute is the closest available proxy for how much was invested in a model, though it says nothing on its own about how well that compute was spent.

These two models share no benchmark on which both have been scored, so no direct performance comparison is possible here. The specification table below is a comparison of inputs, not of results.

Specifications
xAI
Organization
NVIDIA
Feb 17, 2025
Published
Jun 14, 2024
3.5×10²⁶ FLOP
Training compute19x
1.8×10²⁵ FLOP
3T
Parameters8.8x
340B
--
Dataset size
9T
NVIDIA H100 SXM5 80GB
Training hardware
NVIDIA H100 SXM5 80GB
80,000
Chips used13x
6,144
2,160 h
Training time
2,200 h
$218M
Training cost (2023 USD)10x
$21M
109.9 MW
Training power draw
8.5 MW
API access
Accessibility
Open weights (unrestricted)
No
Open weights
Yes
United States
Country
United States
Related comparisons
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.