ESM-AA is an AI model developed by Peking University, Nanjing University, Tsinghua University and PharMolix (China), first published in April 2024. It works in the biology domain, on tasks such as protein folding prediction, protein or nucleotide language model (plm/nlm) and proteins.
Training it took an estimated 7.3×10²⁰ FLOP of compute (estimation method: hardware). The model has 35,000,000 parameters. It was trained on roughly 1.1B datapoints. Training ran on 16 NVIDIA A100 for about 72 hours.
It is built on top of ESM2-35M. The reference paper has 19 citations. Epoch AI rates the confidence of this record as confident.