Conformer + Wav2vec 2.0 + Noisy Student is an AI model developed by Google, Google Research and Google Brain (United States), first published in October 2020. It works in the speech domain, on tasks such as speech recognition (asr).
Training it took an estimated 7.6×10²¹ FLOP of compute (estimation method: hardware). The model has 1,000,000,000 parameters. Training ran on 256 Google TPU v3 for about 168 hours. The compute alone is estimated at $9K in 2023 dollars.
Access: Unreleased. Its weights are not openly released. The reference paper has 332 citations. Epoch AI rates the confidence of this record as confident.