MPT-30B training cluster

Compute

256 H100e

Chips

256

First operational

Jun 20, 2023

MPT-30B training cluster is a large GPU cluster operated by MosaicML. It came online around June 2023. At that moment it ranked number 75 among known clusters.

It is built on 256 NVIDIA H100 SXM5 80GB. That amounts to about 256 H100e of AI compute. The cluster draws roughly 0.37 MW. Its hardware is estimated at $9M.

Epoch AI rates the certainty of this record as confirmed.

Full record

Owner: MosaicML
Status: Existing
Primary chip: NVIDIA H100 SXM5 80GB
Primary chip count: 256
Total AI chips: 256
H100 equivalents: 256
8-bit throughput: 5.1×10¹⁷ OP/s
Power capacity: 0.37 MW
Hardware cost: $9M
First operational: Jun 20, 2023
Rank when it came online: 75
Certainty: Confirmed