A100

H100 equivalents

0.32

Cost per chip

$12K

TDP

400 W

A100 is an AI chip designed by Nvidia, released in November 2020. One unit is worth about 0.32 H100-equivalents of AI compute.

It reaches 3.1×10¹⁴ FLOP/s at 16-bit precision and 6.2×10¹⁴ OP/s at 8-bit. It carries 74.5 GB of memory. Epoch AI estimates its cost at roughly $12K per unit.

Timeline

Units sold: 147.6K (2022-03-31) → 15.1K (2023-12-31)

Full record

Designer: Nvidia
Release date: Nov 16, 2020
H100 equivalents: 0.32
16-bit throughput: 3.1×10¹⁴ FLOP/s
8-bit throughput: 6.2×10¹⁴ OP/s
Memory: 74.5 GB
Memory bandwidth: 1.9 TB
TDP: 400 W
Approximate cost: $12K