Transformer-XL + RMS dynamic eval

Parameters

257M

Published

Apr 17, 2019

Transformer-XL + RMS dynamic eval is an AI model developed by University of Edinburgh (United Kingdom), first published in April 2019. It works in the language domain, on tasks such as language modeling/generation.

Epoch AI has no training-compute estimate for this model. The model has 257,000,000 parameters. It was trained on roughly 103M datapoints.

Access: Unreleased. Its weights are not openly released. The reference paper has 47 citations. Epoch AI rates the confidence of this record as confident.

Full record

Organization: University of Edinburgh
Country of organization: United Kingdom
Domain: Language
Task: Language modeling/generation
Parameters: 257,000,000
Dataset size: 103M
Model accessibility: Unreleased
Open weights: No
Citations: 47
Epoch confidence: Confident