Falcon-180B (Technology Innovation Institute) and GPT-4 (Mar 2023) (OpenAI) are both frontier AI models. Falcon-180B was published in September 2023 and GPT-4 (Mar 2023) in March 2023.
GPT-4 (Mar 2023) was trained on 2.1 x 10^25 FLOP, about 5.6x the compute of Falcon-180B at 3.8 x 10^24 FLOP. Training compute is the closest available proxy for how much was invested in a model, though it says nothing on its own about how well that compute was spent.
GPT-4 (Mar 2023) wins the single benchmark both were scored on. Benchmark counts are a crude scoreboard — the evaluations differ wildly in what they measure and in how saturated they are — so the per-benchmark table below matters more than the tally.
| Field | Falcon-180B | GPT-4 (Mar 2023) |
|---|---|---|
| Organization | Technology Innovation Institute | OpenAI |
| Published | Sep 6, 2023 | Mar 15, 2023 |
| Training compute | 3.8 x 10^24 FLOP | 2.1 x 10^25 FLOP |
| Parameters | 180B | 1.8T |
| Dataset size | 3.5T | 5.4T |
| Training hardware | NVIDIA A100 SXM4 40 GB | NVIDIA A100 SXM4 40 GB |
| Chips used | 4,096 | 25,000 |
| Training time | 4.3K h | 2.3K h |
| Training cost (2023 USD) | $11M | $37M |
| Training power draw | 3.3 MW | 19.9 MW |
| Accessibility | Open weights (restricted use) | API access |
| Open weights | Yes | No |
| Country | United Arab Emirates | United States |
| Benchmark | Falcon-180B | GPT-4 (Mar 2023) |
|---|---|---|
| Epoch Capabilities Index(ECI Score) | 111.9 | 125.9 |
