AI models
GPT-2 (fine-tuned with HYDRA)
Training compute
1.9×10²¹ FLOP
Parameters
1.5B
Published
Oct 16, 2021
GPT-2 (fine-tuned with HYDRA) is an AI model developed by University of California San Diego (United States), first published in October 2021. It works in the language domain, on tasks such as language modeling/generation.
Training it took an estimated 1.9×10²¹ FLOP of compute (estimation method: operation counting). The model has 1,540,000,000 parameters.
Access: Unreleased. Its weights are not openly released. It is built on top of GPT-2 (1.5B). The reference paper has 6 citations. Epoch AI rates the confidence of this record as confident.
Full record
- Organization
- University of California San Diego
- Country of organization
- United States
- Domain
- Language
- Task
- Language modeling/generation
- Training compute
- 1.9×10²¹ FLOP
- Compute estimation method
- Operation counting
- Parameters
- 1,540,000,000
- Model accessibility
- Unreleased
- Open weights
- No
- Base model
- GPT-2 (1.5B)
- Citations
- 6
- Epoch confidence
- Confident
More from University of California San Diego
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models