AI models
AWD-LSTM+WT+Cache+IOG (WT2)
Training compute
3.2×10¹⁵ FLOP
Parameters
53M
Published
Sep 26, 2017
AWD-LSTM+WT+Cache+IOG (WT2) is an AI model developed by NTT Communication Science Laboratories (Japan), first published in September 2017. It works in the language domain, on tasks such as language modeling.
Training it took an estimated 3.2×10¹⁵ FLOP of compute (estimation method: operation counting). The model has 53,000,000 parameters. It was trained on roughly 2M datapoints.
Access: Unreleased. Its weights are not openly released. The reference paper has 7 citations. Epoch AI rates the confidence of this record as confident.
Full record
- Organization
- NTT Communication Science Laboratories
- Country of organization
- Japan
- Domain
- Language
- Task
- Language modeling
- Training compute
- 3.2×10¹⁵ FLOP
- Compute estimation method
- Operation counting
- Parameters
- 53,000,000
- Dataset size
- 2M
- Model accessibility
- Unreleased
- Open weights
- No
- Citations
- 7
- Epoch confidence
- Confident
More from NTT Communication Science Laboratories
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models