Inflection-2

Training compute

10²⁵ FLOP

Published

Nov 22, 2023

Inflection-2 is an AI model developed by Inflection AI (United States), first published in November 2023. It works in the language domain, on tasks such as language modeling, language modeling/generation, chat and question answering. It counts among the frontier models: the systems trained with the most compute of their moment.

Training it took an estimated 10²⁵ FLOP of compute (estimation method: hardware,benchmarks). Training ran on 5,000 NVIDIA H100 SXM5 80GB. The compute alone is estimated at $13M in 2023 dollars.

Access: Hosted access (no API). Its weights are not openly released. Epoch AI rates the confidence of this record as confident.

Full record

Organization: Inflection AI
Country of organization: United States
Domain: Language
Task: Language modeling, Language modeling/generation, Chat, Question answering
Training compute: 10²⁵ FLOP
Compute estimation method: Hardware, Benchmarks
Training hardware: NVIDIA H100 SXM5 80GB
Chips used: 5,000
Training power draw: 6.9 MW
Training cost (2023 USD): $13M
Numerical format: FP8
Model accessibility: Hosted access (no API)
Open weights: No
Epoch confidence: Confident