H200

H100 equivalents

1

Cost per chip

$25K

TDP

700 W

H200 is an AI chip designed by Nvidia, released in November 2024. One unit is worth about 1 H100-equivalent of AI compute.

It reaches 9.9×10¹⁴ FLOP/s at 16-bit precision and 2×10¹⁵ OP/s at 8-bit. It carries 131 GB of memory. Epoch AI estimates its cost at roughly $25K per unit.

Full record

Designer: Nvidia
Release date: Nov 18, 2024
H100 equivalents: 1
16-bit throughput: 9.9×10¹⁴ FLOP/s
8-bit throughput: 2×10¹⁵ OP/s
Memory: 131 GB
Memory bandwidth: 4.4 TB
TDP: 700 W
Approximate cost: $25K