NVIDIA L20 PCle

FP16 throughput

1.2×10¹⁴ FLOP/s

Memory

44.7 GB

TDP

275 W

NVIDIA L20 PCle is an AI accelerator designed by NVIDIA (GPU), released in September 2023. It is built on a 5 nm process at TSMC, packing 76.3B transistors. Its release price was $4K.

It delivers 1.2×10¹⁴ FLOP/s of tensor FP16/BF16 throughput. It carries 44.7 GB of memory at 805 GB/s of bandwidth. Its thermal design power is 275 W.

Full record

Manufacturer: NVIDIA
Type: GPU
Release date: Sep 16, 2023
Release price: $4K
Tensor FP16/BF16: 1.2×10¹⁴ FLOP/s
FP32: 5.9×10¹³ FLOP/s
FP64: 9.3×10¹¹ FLOP/s
INT8: 2.4×10¹⁴ OP/s
Memory: 44.7 GB
Memory bandwidth: 805 GB
TDP: 275 W
Process node: 5 nm
Transistors (millions): 76,300
Die size (mm2): 609
Foundry: TSMC
Tensor cores: 11,776