Lightweight Fine-tuning a Pretrained Protein Language Model for Protein Secondary is an AI model developed by Henan University (China), first published in March 2023. It works in the biology domain, on tasks such as protein or nucleotide language model (plm/nlm) and protein folding prediction.
Training it took an estimated 1.9×10²² FLOP of compute (estimation method: hardware). It was trained on roughly 10M datapoints. Training ran on 1 NVIDIA GeForce RTX 3090 Ti for about 27 hours.
It is built on top of ProtT5-XL-U50. Epoch AI rates the confidence of this record as confident.