GL-LWGC-AWD-MoS-LSTM + dynamic evaluation (PTB)

Training compute

1.4×10¹⁷ FLOP

Parameters

26M

Published

Aug 29, 2017

GL-LWGC-AWD-MoS-LSTM + dynamic evaluation (PTB) is an AI model developed by Ben-Gurion University (Israel), first published in August 2017. It works in the language domain, on tasks such as language modeling.

Training it took an estimated 1.4×10¹⁷ FLOP of compute. The model has 26,000,000 parameters. It was trained on roughly 929K datapoints.

Access: Unreleased. Its weights are not openly released. Epoch AI rates the confidence of this record as confident.

Full record

Organization: Ben-Gurion University
Country of organization: Israel
Domain: Language
Task: Language modeling
Training compute: 1.4×10¹⁷ FLOP
Parameters: 26,000,000
Dataset size: 929K
Model accessibility: Unreleased
Open weights: No
Epoch confidence: Confident