RNN 1000/5 + RT09 LM (NIST RT05) is an AI model developed by Brno University of Technology and Johns Hopkins University (Czechia and United States), first published in September 2010. It works in the speech domain, on tasks such as speech recognition (asr) and transcription. It counts among the frontier models: the systems trained with the most compute of their moment.
Training it took an estimated 5×10¹⁶ FLOP of compute (estimation method: operation counting). The model has 77,039,000 parameters. It was trained on roughly 5.4M datapoints.
Access: Unreleased. Its weights are not openly released. The reference paper has 6,038 citations. Epoch AI rates the confidence of this record as likely.