NVIDIA GB200

FP16 throughput

2.5×10¹⁵ FLOP/s

Memory

173 GB

TDP

1.2 kW

NVIDIA GB200 is an AI accelerator designed by NVIDIA (GPU), released in February 2025.

It delivers 2.5×10¹⁵ FLOP/s of tensor FP16/BF16 throughput, 5×10¹⁵ FLOP/s at FP8 and 10¹⁶ FLOP/s at FP4. It carries 173 GB of memory at 7.3 TB/s of bandwidth. Its thermal design power is 1.2 kW.

Full record

Manufacturer: NVIDIA
Type: GPU
Release date: Feb 15, 2025
Tensor FP16/BF16: 2.5×10¹⁵ FLOP/s
FP8: 5×10¹⁵ FLOP/s
FP4: 10¹⁶ FLOP/s
FP32: 9×10¹³ FLOP/s
FP64: 4.5×10¹³ FLOP/s
INT8: 5×10¹⁵ OP/s
Memory: 173 GB
Memory bandwidth: 7.3 TB
TDP: 1.2 kW
Foundry: TSMC