NVIDIA L4 is an AI accelerator designed by NVIDIA (GPU), released in March 2023. It is built on a 5 nm process at TSMC, packing 35.8B transistors.
It delivers 1.2×10¹⁴ FLOP/s of tensor FP16/BF16 throughput. It carries 22.4 GB of memory at 279 GB/s of bandwidth. Its thermal design power is 72 W.