NVIDIA H100 SXM5 80GB

FP16 throughput

9.9×10¹⁴ FLOP/s

Memory

74.5 GB

TDP

700 W

NVIDIA H100 SXM5 80GB is an AI accelerator designed by NVIDIA (GPU), released in September 2022. It is built on a 5 nm process at TSMC, packing 80B transistors. Its release price was $34K.

It delivers 9.9×10¹⁴ FLOP/s of tensor FP16/BF16 throughput, 2×10¹⁵ FLOP/s at FP8. It carries 74.5 GB of memory at 3 TB/s of bandwidth. Its thermal design power is 700 W.

Full record

Manufacturer: NVIDIA
Type: GPU
Release date: Sep 20, 2022
Release price: $34K
Tensor FP16/BF16: 9.9×10¹⁴ FLOP/s
FP8: 2×10¹⁵ FLOP/s
FP32: 6.7×10¹³ FLOP/s
FP64: 3.3×10¹³ FLOP/s
INT8: 2×10¹⁵ OP/s
Memory: 74.5 GB
Memory bandwidth: 3 TB
TDP: 700 W
Process node: 5 nm
Transistors (millions): 80,000
Die size (mm2): 814
Foundry: TSMC
Tensor cores: 528