AI models
PLLaMa
Training compute
1.6×10²³ FLOP
Parameters
13B
Published
Jan 3, 2024
PLLaMa is an AI model developed by University of California Santa Barbara (UCSB), University of Lincoln, Chinese Academy of Agricultural Sciences and Swedish University of Agricultural Sciences (United States, United Kingdom, China and Sweden), first published in January 2024. It works in the biology domain, on tasks such as language modeling/generation.
Training it took an estimated 1.6×10²³ FLOP of compute (estimation method: hardware). The model has 13,000,000,000 parameters. Training ran on 8 NVIDIA A100 for about 59.7 hours.
Access: Open weights (unrestricted). Its weights are openly available. It is built on top of Llama 2-13B. The reference paper has 39 citations. Epoch AI rates the confidence of this record as confident.
Full record
- Organization
- University of California Santa Barbara (UCSB), University of Lincoln, Chinese Academy of Agricultural Sciences, Swedish University of Agricultural Sciences
- Country of organization
- United States, United Kingdom, China, Sweden
- Domain
- Biology
- Task
- Language modeling/generation
- Training compute
- 1.6×10²³ FLOP
- Compute estimation method
- Hardware
- Parameters
- 13,000,000,000
- Training hardware
- NVIDIA A100
- Chips used
- 8
- Training time
- 60 h
- Training power draw
- 6.3 kW
- Model accessibility
- Open weights (unrestricted)
- Open weights
- Yes
- Base model
- Llama 2-13B
- Citations
- 39
- Epoch confidence
- Confident
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models