Claude 3.5 Sonnet vs Falcon-180B

Claude 3.5 Sonnet (Anthropic) and Falcon-180B (Technology Innovation Institute) are both frontier AI models. Claude 3.5 Sonnet was published in June 2024 and Falcon-180B in September 2023.

Claude 3.5 Sonnet was trained on 2.7×10²⁵ FLOP, about 7.2x the compute of Falcon-180B at 3.8×10²⁴ FLOP. Training compute is the closest available proxy for how much was invested in a model, though it says nothing on its own about how well that compute was spent.

Claude 3.5 Sonnet wins the single benchmark both were scored on. Benchmark counts are a crude scoreboard — the evaluations differ wildly in what they measure and in how saturated they are — so the per-benchmark table below matters more than the tally.