Oracle OCI MI300x
Oracle OCI MI300x is a large GPU cluster operated by Oracle, located in the United States, in the private sector. It came online around November 2024. At that moment it ranked number 8 among known clusters.
It is built on 16,384 AMD Instinct MI300X. That amounts to about 21.6K H100e of AI compute. The cluster draws roughly 25.05 MW. Its hardware is estimated at $446M.
Epoch AI rates the certainty of this record as likely. Unclear exactly when this first became operational, if it was ever built. The announcement September 2024 states that MI300x clusters are now available, and can scale up to 16k GPUs. It's unclear whether this implies that they have already built a 16k MI300x cluster, or if they are just accepting orders to. It seems very likely that this cluster has been built, but I estimate the first operational date as Q4 2024 to be more conservative
- Owner
- Oracle
- Users
- Cloud
- Sector
- Private
- Status
- Existing
- Country
- United States
- Primary chip
- AMD Instinct MI300X
- Primary chip count
- 16,384
- Total AI chips
- 16,384
- H100 equivalents
- 21.6K
- 8-bit throughput
- 4.3×10¹⁹ OP/s
- Power capacity
- 25.05 MW
- Hardware cost
- $446M
- First operational
- Nov 15, 2024
- Rank when it came online
- 8
- Certainty
- Likely