Live
AI models

CPM-2

Training compute
3.6×10²² FLOP
Parameters
11B
Published
Jun 24, 2021

CPM-2 is an AI model developed by Tsinghua University and Beijing Academy of Artificial Intelligence / BAAI (China), first published in June 2021. It works in the language domain, on tasks such as language generation.

Training it took an estimated 3.6×10²² FLOP of compute (estimation method: operation counting). The model has 11,000,000,000 parameters. It was trained on roughly 69.6B datapoints.

The reference paper has 101 citations. Epoch AI rates the confidence of this record as likely.

Full record
Organization
Tsinghua University, Beijing Academy of Artificial Intelligence / BAAI
Country of organization
China
Domain
Language
Task
Language generation
Training compute
3.6×10²² FLOP
Compute estimation method
Operation counting
Parameters
11,000,000,000
Dataset size
69.6B
Citations
101
Epoch confidence
Likely
More from Tsinghua University,Beijing Academy of Artificial Intelligence / BAAI
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models