TPU v4

H100 equivalents

0.14

Cost per chip

$4K

TDP

340 W

TPU v4 is an AI chip designed by Google, released in May 2021. One unit is worth about 0.14 H100-equivalents of AI compute.

It reaches 2.8×10¹⁴ FLOP/s at 16-bit precision and 2.8×10¹⁴ OP/s at 8-bit. It carries 29.8 GB of memory. Epoch AI estimates its cost at roughly $4K per unit.

Timeline

Units sold: 66.4K (2022-12-31) → 11.4K (2023-09-30)

Full record

Designer: Google
Release date: May 20, 2021
H100 equivalents: 0.14
16-bit throughput: 2.8×10¹⁴ FLOP/s
8-bit throughput: 2.8×10¹⁴ OP/s
Memory: 29.8 GB
Memory bandwidth: 1.1 TB
TDP: 340 W
Approximate cost: $4K