Microsoft Azure ND H100 v5 VM

Compute

4K H100e

Chips

4,000

First operational

Mar 13, 2023

Microsoft Azure ND H100 v5 VM is a large GPU cluster operated by Microsoft, located in the United States, in the private sector. It came online around March 2023. At that moment it ranked number 7 among known clusters.

It is built on 4,000 NVIDIA H100 SXM5 80GB. That amounts to about 4K H100e of AI compute. The cluster draws roughly 5.81 MW. Its hardware is estimated at $191M.

Epoch AI rates the certainty of this record as confirmed. Planned to scale up

Full record

Owner: Microsoft
Users: Cloud, Azure
Sector: Private
Status: Existing
Country: United States
Primary chip: NVIDIA H100 SXM5 80GB
Primary chip count: 4,000
Total AI chips: 4,000
H100 equivalents: 4K
8-bit throughput: 7.9×10¹⁸ OP/s
Power capacity: 5.81 MW
Hardware cost: $191M
First operational: Mar 13, 2023
Rank when it came online: 7
Certainty: Confirmed