AI models
CPM-Bee
Training compute
6×10²² FLOP
Parameters
10B
Published
Mar 24, 2023
CPM-Bee is an AI model developed by Tsinghua University, Beijing Academy of Artificial Intelligence / BAAI, ModelBest and OpenBMB (Open Lab for Big Model Base) (China), first published in March 2023. It works in the language domain, on tasks such as language modeling/generation and question answering.
Training it took an estimated 6×10²² FLOP of compute (estimation method: operation counting). The model has 10,000,000,000 parameters. It was trained on roughly 140.1B datapoints.
Access: Open weights (unrestricted). Its weights are openly available. Epoch AI rates the confidence of this record as confident.
Full record
- Organization
- Tsinghua University, Beijing Academy of Artificial Intelligence / BAAI, ModelBest, OpenBMB (Open Lab for Big Model Base)
- Country of organization
- China
- Domain
- Language
- Task
- Language modeling/generation, Question answering
- Training compute
- 6×10²² FLOP
- Compute estimation method
- Operation counting
- Parameters
- 10,000,000,000
- Dataset size
- 140.1B
- Model accessibility
- Open weights (unrestricted)
- Open weights
- Yes
- Epoch confidence
- Confident
More from Tsinghua University,Beijing Academy of Artificial Intelligence / BAAI,ModelBest,OpenBMB (Open Lab for Big Model Base)
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models