Claude 3.5 Sonnet (Anthropic) and GPT-4 (Jun 2023) (OpenAI) are both frontier AI models. Claude 3.5 Sonnet was published in June 2024 and GPT-4 (Jun 2023) in June 2023.
Claude 3.5 Sonnet was trained on 2.7 x 10^25 FLOP, about 1.3x the compute of GPT-4 (Jun 2023) at 2.1 x 10^25 FLOP. Training compute is the closest available proxy for how much was invested in a model, though it says nothing on its own about how well that compute was spent.
Claude 3.5 Sonnet wins the single benchmark both were scored on. Benchmark counts are a crude scoreboard — the evaluations differ wildly in what they measure and in how saturated they are — so the per-benchmark table below matters more than the tally.
| Field | Claude 3.5 Sonnet | GPT-4 (Jun 2023) |
|---|---|---|
| Organization | Anthropic | OpenAI |
| Published | Jun 20, 2024 | Jun 13, 2023 |
| Training compute | 2.7 x 10^25 FLOP | 2.1 x 10^25 FLOP |
| Parameters | — | 1.8T |
| Dataset size | — | 5.4T |
| Training hardware | — | NVIDIA A100 SXM4 40 GB |
| Chips used | — | 25,000 |
| Training time | — | 2.3K h |
| Training cost (2023 USD) | $26M | — |
| Training power draw | — | 19.9 MW |
| Accessibility | API access | API access |
| Open weights | No | No |
| Country | United States | United States |
| Benchmark | Claude 3.5 Sonnet | GPT-4 (Jun 2023) |
|---|---|---|
| Epoch Capabilities Index(ECI Score) | 130 | 121.9 |