TSUBAME4.0 is a large GPU cluster operated by Tokyo Institute of Technology, located in Japan, in the public sector. It came online around April 2024. At that moment it ranked number 68 among known clusters.
It is built on 960 NVIDIA H100 SXM5 80GB. That amounts to about 960 H100e of AI compute. The cluster draws roughly 1.36 MW. Its hardware is estimated at $34M.
Epoch AI rates the certainty of this record as confirmed.