AI models
ProtGPT2
Training compute
4.1×10²¹ FLOP
Parameters
738M
Published
Jul 27, 2022
ProtGPT2 is an AI model developed by University of Bayreuth (Germany), first published in July 2022. It works in the biology domain, on tasks such as proteins, protein generation and protein or nucleotide language model (plm/nlm).
Training it took an estimated 4.1×10²¹ FLOP of compute (estimation method: hardware,third-party estimation). The model has 738,000,000 parameters. It was trained on roughly 25.5B datapoints. Training ran on 128 NVIDIA A100 for about 96 hours.
Access: Open weights (unrestricted). Its weights are openly available. The reference paper has 689 citations. Epoch AI rates the confidence of this record as confident.
Full record
- Organization
- University of Bayreuth
- Country of organization
- Germany
- Domain
- Biology
- Task
- Proteins, Protein generation, Protein or nucleotide language model (pLM/nLM)
- Training compute
- 4.1×10²¹ FLOP
- Compute estimation method
- Hardware, Third-party estimation
- Parameters
- 738,000,000
- Dataset size
- 25.5B
- Training hardware
- NVIDIA A100
- Chips used
- 128
- Training time
- 96 h
- Chip-hours
- 12.3K
- Training power draw
- 102.6 kW
- Model accessibility
- Open weights (unrestricted)
- Open weights
- Yes
- Citations
- 689
- Epoch confidence
- Confident
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models