H100

H100 equivalents

1

Cost per chip

$25K

TDP

700 W

H100 is an AI chip designed by Nvidia, released in September 2022. One unit is worth about 1 H100-equivalent of AI compute.

It reaches 9.9×10¹⁴ FLOP/s at 16-bit precision and 2×10¹⁵ OP/s at 8-bit. It carries 74.5 GB of memory. Epoch AI estimates its cost at roughly $25K per unit.

Timeline

Compute sold (H100e): 6.1K (2022-09-30) → 4.3M (2026-06-30)

Full record

Designer: Nvidia
Release date: Sep 20, 2022
H100 equivalents: 1
16-bit throughput: 9.9×10¹⁴ FLOP/s
8-bit throughput: 2×10¹⁵ OP/s
Memory: 74.5 GB
Memory bandwidth: 3 TB
TDP: 700 W
Approximate cost: $25K