AI models
Transformer-XL + AutoDropout (WT2)
Parameters
35M
Published
Jan 5, 2021
Transformer-XL + AutoDropout (WT2) is an AI model developed by Google Brain and Carnegie Mellon University (CMU) (United States), first published in January 2021. It works in the language domain, on tasks such as language modeling and translation.
Epoch AI has no training-compute estimate for this model. The model has 35,000,000 parameters.
Access: Unreleased. Its weights are not openly released. The reference paper has 63 citations.
Full record
- Organization
- Google Brain, Carnegie Mellon University (CMU)
- Country of organization
- United States
- Domain
- Language
- Task
- Language modeling, Translation
- Parameters
- 35,000,000
- Model accessibility
- Unreleased
- Open weights
- No
- Citations
- 63
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models