AWD-FWM (PTB) is an AI model developed by IDSIA and Microsoft Research (Switzerland and United States), first published in November 2020. It works in the language domain, on tasks such as language modeling.
Epoch AI has no training-compute estimate for this model. The model has 24,000,000 parameters.
Access: Unreleased. Its weights are not openly released. The reference paper has 64 citations. Epoch AI rates the confidence of this record as confident.