MMLSTM (WT-103) is an AI model developed by Beijing University of Posts and Telecommunications and University of West London (China and United Kingdom), first published in December 2019. It works in the language domain, on tasks such as language modeling.
Training it took an estimated 2.3×10¹⁸ FLOP of compute (estimation method: operation counting). The model has 75,000,000 parameters. It was trained on roughly 103M datapoints.
Access: Unreleased. Its weights are not openly released. The reference paper has 19 citations. Epoch AI rates the confidence of this record as likely.