Instinct MI308X

H100 equivalents

0.33

Cost per chip

$12K

TDP

750 W

Instinct MI308X is an AI chip designed by AMD, released in December 2023. One unit is worth about 0.33 H100-equivalents of AI compute. It is a variant built specifically for the Chinese market under export controls.

It reaches 6.5×10¹⁴ FLOP/s at 16-bit precision and 6.5×10¹⁴ OP/s at 8-bit. It carries 179 GB of memory. Epoch AI estimates its cost at roughly $12K per unit.

Full record

Designer: AMD
Release date: Dec 6, 2023
H100 equivalents: 0.33
16-bit throughput: 6.5×10¹⁴ FLOP/s
8-bit throughput: 6.5×10¹⁴ OP/s
Memory: 179 GB
Memory bandwidth: 9.4 TB
TDP: 750 W
Approximate cost: $12K
Made for the Chinese market: Yes