GPU clusters
Together AI H100 Cluster
Compute
4.4K H100e
Chips
4,424
First operational
Oct 16, 2023
Together AI H100 Cluster is a large GPU cluster operated by Together, located in the United States, in the private sector. It came online around October 2023. At that moment it ranked number 9 among known clusters.
It is built on 4,424 NVIDIA H100 SXM5 80GB. That amounts to about 4.4K H100e of AI compute. The cluster draws roughly 6.43 MW. Its hardware is estimated at $147M.
Epoch AI rates the certainty of this record as likely. Unclear if all the GPUs are networked together
Full record
- Owner
- Together
- Users
- Cloud
- Sector
- Private
- Status
- Existing
- Country
- United States
- Primary chip
- NVIDIA H100 SXM5 80GB
- Primary chip count
- 4,424
- Total AI chips
- 4,424
- H100 equivalents
- 4.4K
- 8-bit throughput
- 8.8×10¹⁸ OP/s
- Power capacity
- 6.43 MW
- Hardware cost
- $147M
- First operational
- Oct 16, 2023
- Rank when it came online
- 9
- Certainty
- Likely
SourceEpoch AI, 'GPU Clusters'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/gpu-clusters. Licensed under CC BY 4.0.
← All gpu clusters