2-layer skip-LSTM + dropout tuning (PTB)

Parameters

24M

Published

May 23, 2018

2-layer skip-LSTM + dropout tuning (PTB) is an AI model developed by DeepMind (United Kingdom), first published in May 2018. It works in the language domain, on tasks such as language modeling.

Epoch AI has no training-compute estimate for this model. The model has 24,000,000 parameters.

Access: Unreleased. Its weights are not openly released. It is built on top of AWD-LSTM. Epoch AI rates the confidence of this record as confident.

Full record

Organization: DeepMind
Country of organization: United Kingdom
Domain: Language
Task: Language modeling
Parameters: 24,000,000
Model accessibility: Unreleased
Open weights: No
Base model: AWD-LSTM
Epoch confidence: Confident