NVIDIA H200 SXM

FP16 throughput

9.9×10¹⁴ FLOP/s

Memory

131 GB

TDP

700 W

NVIDIA H200 SXM is an AI accelerator designed by NVIDIA (GPU), released in November 2024. It is built on a 5 nm process at TSMC. Its release price was $30K.

It delivers 9.9×10¹⁴ FLOP/s of tensor FP16/BF16 throughput, 2×10¹⁵ FLOP/s at FP8. It carries 131 GB of memory at 4.4 TB/s of bandwidth. Its thermal design power is 700 W.

Full record

Manufacturer: NVIDIA
Type: GPU
Release date: Nov 18, 2024
Release price: $30K
Tensor FP16/BF16: 9.9×10¹⁴ FLOP/s
FP8: 2×10¹⁵ FLOP/s
FP32: 6.7×10¹³ FLOP/s
FP64: 3.3×10¹³ FLOP/s
INT8: 2×10¹⁵ OP/s
Memory: 131 GB
Memory bandwidth: 4.4 TB
TDP: 700 W
Process node: 5 nm
Foundry: TSMC