Trainium2

H100 equivalents

0.66

Cost per chip

$4K

TDP

500 W

Trainium2 is an AI chip designed by Amazon, released in December 2024. One unit is worth about 0.66 H100-equivalents of AI compute.

It reaches 6.7×10¹⁴ FLOP/s at 16-bit precision and 1.3×10¹⁵ OP/s at 8-bit. It carries 89.4 GB of memory. Epoch AI estimates its cost at roughly $4K per unit.

Timeline

Units sold: 15K (2024-03-31) → 335K (2025-12-31)

Full record

Designer: Amazon
Release date: Dec 3, 2024
H100 equivalents: 0.66
16-bit throughput: 6.7×10¹⁴ FLOP/s
8-bit throughput: 1.3×10¹⁵ OP/s
Memory: 89.4 GB
Memory bandwidth: 2.6 TB
TDP: 500 W
Approximate cost: $4K