Grok-2

Training compute

3×10²⁵ FLOP

Published

Aug 13, 2024

Grok-2 is an AI model developed by xAI (United States), first published in August 2024. It works in the language, vision and multimodal domain, on tasks such as chat, language modeling/generation, question answering and 2 more. It counts among the frontier models: the systems trained with the most compute of their moment.

Training it took an estimated 3×10²⁵ FLOP of compute (estimation method: comparison with other models,reported). Training ran on NVIDIA H100 SXM5 80GB. The compute alone is estimated at $32M in 2023 dollars.

Access: API access. Its weights are not openly released. Epoch AI rates the confidence of this record as confident.

Full record

Organization: xAI
Country of organization: United States
Domain: Language, Vision, Multimodal
Task: Chat, Language modeling/generation, Question answering, Code generation, Visual question answering
Training compute: 3×10²⁵ FLOP
Compute estimation method: Comparison with other models, Reported
Training hardware: NVIDIA H100 SXM5 80GB
Training cost (2023 USD): $32M
Model accessibility: API access
Open weights: No
Epoch confidence: Confident

Benchmark results

01

Epoch Capabilities Index

ECI Score

130.8