Oracle OCI Supercluster H100s
Oracle OCI Supercluster H100s is a large GPU cluster operated by Oracle, located in the United States, in the private sector. It came online around April 2024. At that moment it ranked number 3 among known clusters.
It is built on 16,384 NVIDIA H100 SXM5 80GB. That amounts to about 16.4K H100e of AI compute. The cluster draws roughly 23.38 MW. Its hardware is estimated at $585M.
Epoch AI rates the certainty of this record as likely. Unclear when this was first operational. In November 2023, they state that OCI superclusters "can scale up to" 16k H100s. However, it's unclear whether they had actually built a 16k cluster yet, or were just accepting orders. Musk's xAI was said to be renting 16k of these GPUs in May 2024, signaling that at least one Oracle cluster of this size was operational by then. I mark the first operational date as April 2024 to be slightly conservative. Also, it's very likely that Oracle has several of these 16k H100 clusters
- Owner
- Oracle
- Users
- Cloud, Cohere, xAI
- Sector
- Private
- Status
- Existing
- Country
- United States
- Primary chip
- NVIDIA H100 SXM5 80GB
- Primary chip count
- 16,384
- Total AI chips
- 16,384
- H100 equivalents
- 16.4K
- 8-bit throughput
- 3.2×10¹⁹ OP/s
- Power capacity
- 23.38 MW
- Hardware cost
- $585M
- First operational
- Apr 15, 2024
- Rank when it came online
- 3
- Certainty
- Likely