2-layer skip-LSTM + dropout tuning (WT2)

Parameters

5.4M

Published

May 23, 2018

2-layer skip-LSTM + dropout tuning (WT2) is an AI model developed by DeepMind (United Kingdom), first published in May 2018. It works in the language domain, on tasks such as language modeling.

Epoch AI has no training-compute estimate for this model. The model has 5,400,000 parameters.

Access: Unreleased. Its weights are not openly released. The reference paper has 14 citations.

Full record

Organization: DeepMind
Country of organization: United Kingdom
Domain: Language
Task: Language modeling
Parameters: 5,400,000
Model accessibility: Unreleased
Open weights: No
Citations: 14