NVIDIA A800 PCIe 40 GB

FP16 throughput

3.1×10¹⁴ FLOP/s

TDP

250 W

NVIDIA A800 PCIe 40 GB is an AI accelerator designed by NVIDIA (GPU), released in November 2022. It is built on a 7 nm process at TSMC, packing 54.2B transistors.

It delivers 3.1×10¹⁴ FLOP/s of tensor FP16/BF16 throughput. Its thermal design power is 250 W.

Full record

Manufacturer: NVIDIA
Type: GPU
Release date: Nov 8, 2022
Tensor FP16/BF16: 3.1×10¹⁴ FLOP/s
FP32: 1.9×10¹³ FLOP/s
FP64: 9.7×10¹² FLOP/s
Memory bandwidth: 1.4 TB
TDP: 250 W
Process node: 7 nm
Transistors (millions): 54,200
Die size (mm2): 826
Foundry: TSMC
Tensor cores: 432