Transformer ELMo is an AI model developed by Allen Institute for AI and University of Washington (United States), first published in January 2019. It works in the language domain, on tasks such as language modeling.
Epoch AI has no training-compute estimate for this model. The model has 56,000,000 parameters. It was trained on roughly 2B datapoints.
Access: Unreleased. Its weights are not openly released. The reference paper has 459 citations. Epoch AI rates the confidence of this record as confident.