NVIDIA In-house DGX A100 Cluster

Compute

126 H100e

Chips

400

First operational

May 14, 2020

NVIDIA In-house DGX A100 Cluster is a large GPU cluster operated by NVIDIA, located in the United States, in the private sector. It came online around May 2020. At that moment it ranked number 17 among known clusters.

It is built on 400 NVIDIA A100. That amounts to about 126 H100e of AI compute. The cluster draws roughly 0.35 MW. Its hardware is estimated at $11M.

Epoch AI rates the certainty of this record as likely. 50 nodes x 8 A100 per node

Full record

Owner: NVIDIA
Users: NVIDIA
Sector: Private
Status: Existing
Country: United States
Primary chip: NVIDIA A100
Primary chip count: 400
Total AI chips: 400
H100 equivalents: 126
8-bit throughput: 2.5×10¹⁷ OP/s
Power capacity: 0.35 MW
Hardware cost: $11M
First operational: May 14, 2020
Rank when it came online: 17
Certainty: Likely