AI models
GPT-2 + Progressive LRD
Training compute
7.9×10²⁰ FLOP
Parameters
31M
Published
Oct 12, 2022
GPT-2 + Progressive LRD is an AI model developed by Huawei and Huawei Noah's Ark Lab (China), first published in October 2022. It works in the language domain, on tasks such as language modeling/generation.
Training it took an estimated 7.9×10²⁰ FLOP of compute (estimation method: comparison with other models). The model has 31,000,000 parameters.
Access: Unreleased. Its weights are not openly released. It is built on top of GPT-2 (124M). Epoch AI rates the confidence of this record as speculative.
Full record
- Organization
- Huawei, Huawei Noah's Ark Lab
- Country of organization
- China
- Domain
- Language
- Task
- Language modeling/generation
- Training compute
- 7.9×10²⁰ FLOP
- Compute estimation method
- Comparison with other models
- Parameters
- 31,000,000
- Model accessibility
- Unreleased
- Open weights
- No
- Base model
- GPT-2 (124M)
- Epoch confidence
- Speculative
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models