Amazon Trainium2

FP16 throughput

6.7×10¹⁴ FLOP/s

Memory

89.4 GB

TDP

500 W

Amazon Trainium2 is an AI accelerator designed by Amazon AWS (GPU), released in December 2024.

It delivers 6.7×10¹⁴ FLOP/s of tensor FP16/BF16 throughput, 1.3×10¹⁵ FLOP/s at FP8. It carries 89.4 GB of memory at 2.6 TB/s of bandwidth. Its thermal design power is 500 W.

Full record

Manufacturer: Amazon AWS
Type: GPU
Release date: Dec 3, 2024
Tensor FP16/BF16: 6.7×10¹⁴ FLOP/s
FP8: 1.3×10¹⁵ FLOP/s
Memory: 89.4 GB
Memory bandwidth: 2.6 TB
TDP: 500 W