UL2

UL2 is an AI model developed by Google Research and Google Brain (United States), first published in May 2022. It works in the language domain, on tasks such as language modeling/generation, question answering and text summarization.

Training it took an estimated 1.2×10²³ FLOP of compute (estimation method: hardware,operation counting). The model has 20,000,000,000 parameters. It was trained on roughly 1T datapoints. Training ran on 512 Google TPU v4 for about 744 hours. The compute alone is estimated at $127K in 2023 dollars.

Access: Open weights (unrestricted). Its weights are openly available. The reference paper has 387 citations. Epoch AI rates the confidence of this record as confident.