PLUG training cluster is a large GPU cluster. It came online around April 2021. At that moment it ranked number 86 among known clusters.
It is built on 128 NVIDIA A100. That amounts to about 40.36 H100e of AI compute. The cluster draws roughly 0.11 MW. Its hardware is estimated at $3M.
Epoch AI rates the certainty of this record as likely.