IBM Blue Vela is a large GPU cluster operated by IBM, located in the United States, in the private sector. It came online around July 2024. At that moment it ranked number 77 among known clusters.
It is built on 1,024 NVIDIA H100 SXM5 80GB. That amounts to about 1K H100e of AI compute. The cluster draws roughly 1.46 MW. Its hardware is estimated at $36M.
Epoch AI rates the certainty of this record as likely. There's 128x8=1,024 GPUs per pod, and it's implied that there's multiple pods, implying that there are thousands of GPUs, but this is all the information I have