MosaicML MPT training cluster

Compute

139 H100e

Chips

440

First operational

Mar 5, 2023

MosaicML MPT training cluster is a large GPU cluster operated by MosaicML. It came online around March 2023. At that moment it ranked number 106 among known clusters.

It is built on 440 NVIDIA A100. That amounts to about 139 H100e of AI compute. The cluster draws roughly 0.37 MW. Its hardware is estimated at $10M.

Epoch AI rates the certainty of this record as confirmed.

Full record

Owner: MosaicML
Status: Existing
Primary chip: NVIDIA A100
Primary chip count: 440
Total AI chips: 440
H100 equivalents: 139
8-bit throughput: 2.7×10¹⁷ OP/s
Power capacity: 0.37 MW
Hardware cost: $10M
First operational: Mar 5, 2023
Rank when it came online: 106
Certainty: Confirmed