Tranception is an AI model developed by University of Oxford, Harvard Medical School and Cohere (United Kingdom, United States and Canada), first published in May 2022. It works in the biology domain, on tasks such as proteins and protein pathogenicity prediction.
Training it took an estimated 7.2×10²¹ FLOP of compute (estimation method: hardware). The model has 700,000,000 parameters. It was trained on roughly 48.2B datapoints. Training ran on 64 NVIDIA A100 for about 336 hours. The compute alone is estimated at $15K in 2023 dollars.
Access: Open weights (unrestricted). Its weights are openly available. The reference paper has 243 citations. Epoch AI rates the confidence of this record as confident.