Meta GenAI 2024b

Compute

24.6K H100e

Chips

24,576

First operational

Mar 12, 2024

Meta GenAI 2024b is a large GPU cluster operated by Meta AI, located in the United States, in the private sector. It came online around March 2024. At that moment it ranked number 1 among known clusters.

It is built on 24,576 NVIDIA H100 SXM5 80GB. That amounts to about 24.6K H100e of AI compute. The cluster draws roughly 35.07 MW. Its hardware is estimated at $880M.

Epoch AI rates the certainty of this record as confirmed. At least one of these was used to train Llama 3

Full record

Owner: Meta AI
Users: Meta
Sector: Private
Status: Existing
Country: United States
Primary chip: NVIDIA H100 SXM5 80GB
Primary chip count: 24,576
Total AI chips: 24,576
H100 equivalents: 24.6K
8-bit throughput: 4.9×10¹⁹ OP/s
Power capacity: 35.07 MW
Hardware cost: $880M
First operational: Mar 12, 2024
Rank when it came online: 1
Certainty: Confirmed