Beyond ESM2: Graph-Enhanced Protein Sequence Modeling with Efficient is an AI model developed by Huazhong University of Science and Technology, Fudan University and Northwestern Polytechnical University (China), first published in April 2024. It works in the biology domain, on tasks such as protein or nucleotide language model (plm/nlm).
Epoch AI has no training-compute estimate for this model. The model has 35,800,000 parameters. It was trained on roughly 30.8M datapoints.
It is built on top of ESM2-35M. Epoch AI rates the confidence of this record as confident.