AI models
CPM-Large
Training compute
2.6×10²⁰ FLOP
Parameters
2.6B
Published
Dec 1, 2020
CPM-Large is an AI model developed by Tsinghua University and Beijing Academy of Artificial Intelligence / BAAI (China), first published in December 2020. It works in the language domain, on tasks such as language modeling.
Training it took an estimated 2.6×10²⁰ FLOP of compute (estimation method: third-party estimation). The model has 2,600,000,000 parameters. It was trained on roughly 16.7B datapoints. Training ran on 64 NVIDIA V100 for about 336 hours. The compute alone is estimated at $7K in 2023 dollars.
Access: Open weights (unrestricted). Its weights are openly available. The reference paper has 129 citations. Epoch AI rates the confidence of this record as confident.
Full record
- Organization
- Tsinghua University, Beijing Academy of Artificial Intelligence / BAAI
- Country of organization
- China
- Domain
- Language
- Task
- Language modeling
- Training compute
- 2.6×10²⁰ FLOP
- Compute estimation method
- Third-party estimation
- Parameters
- 2,600,000,000
- Dataset size
- 16.7B
- Training hardware
- NVIDIA V100
- Chips used
- 64
- Training time
- 336 h
- Training power draw
- 39.0 kW
- Training cost (2023 USD)
- $7K
- Model accessibility
- Open weights (unrestricted)
- Open weights
- Yes
- Citations
- 129
- Epoch confidence
- Confident
More from Tsinghua University,Beijing Academy of Artificial Intelligence / BAAI
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models