AI models
GPT-2+Active-SGD (WT2)
Training compute
3×10¹⁷ FLOP
Parameters
124M
Published
Jan 24, 2023
GPT-2+Active-SGD (WT2) is an AI model developed by University of Montreal / Université de Montréal (Canada), first published in January 2023. It works in the language domain, on tasks such as language modeling.
Training it took an estimated 3×10¹⁷ FLOP of compute (estimation method: operation counting). The model has 124,000,000 parameters. Training ran on 1 NVIDIA P100,NVIDIA V100.
Access: Unreleased. Its weights are not openly released. Epoch AI rates the confidence of this record as likely.
Full record
- Organization
- University of Montreal / Université de Montréal
- Country of organization
- Canada
- Domain
- Language
- Task
- Language modeling
- Training compute
- 3×10¹⁷ FLOP
- Compute estimation method
- Operation counting
- Parameters
- 124,000,000
- Training hardware
- NVIDIA P100, NVIDIA V100
- Chips used
- 1
- Model accessibility
- Unreleased
- Open weights
- No
- Citations
- 0
- Epoch confidence
- Likely
More from University of Montreal / Université de Montréal
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models