AI models
OPT-66B
Training compute
1.1×10²³ FLOP
Parameters
66B
Published
Jun 21, 2022
OPT-66B is an AI model developed by Meta AI (United States), first published in June 2022. It works in the language domain, on tasks such as language modeling, chat, language modeling/generation and question answering.
Training it took an estimated 1.1×10²³ FLOP of compute (estimation method: operation counting). The model has 66,000,000,000 parameters. It was trained on roughly 180B datapoints. Training ran on NVIDIA A100 SXM4 80 GB.
Access: Open weights (non-commercial). Its weights are openly available. The reference paper has 4,716 citations. Epoch AI rates the confidence of this record as confident.
Full record
- Organization
- Meta AI
- Country of organization
- United States
- Domain
- Language
- Task
- Language modeling, Chat, Language modeling/generation, Question answering
- Training compute
- 1.1×10²³ FLOP
- Compute estimation method
- Operation counting
- Parameters
- 66,000,000,000
- Dataset size
- 180B
- Training hardware
- NVIDIA A100 SXM4 80 GB
- Model accessibility
- Open weights (non-commercial)
- Open weights
- Yes
- Citations
- 4,716
- Epoch confidence
- Confident
More from Meta AI
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models