xAI Colossus Memphis Phase 2 is a large GPU cluster operated by xAI, located in the United States, in the private sector. It came online around February 2025. At that moment it ranked number 1 among known clusters.
It is built on 150,000 NVIDIA H100 SXM5 80GB, alongside NVIDIA H200 SXM. That amounts to about 200K H100e of AI compute. The cluster draws roughly 280 MW. Its hardware is estimated at $7.1B.
Epoch AI rates the certainty of this record as likely. GPU types is from a tweet. Unclear exactly when it was first operational. It was confirmed to be operational Feb 17, 2025, but some evidence suggests that it was operational by December 4th, 2024