Oak Ridge NL Frontier is a large GPU cluster operated by US Department of Energy, located in the United States, in the public sector. It came online around May 2022. At that moment it ranked number 2 among known clusters.
It is built on 37,632 AMD Radeon Instinct MI250X. That amounts to about 7.3K H100e of AI compute. The cluster draws roughly 40 MW. Its hardware is estimated at $620M.
Epoch AI rates the certainty of this record as confirmed. (9408 nodes)x(4 GPUs/node) = 37,632 GPUs