P-LLama3

Training compute

7.2×10²³ FLOP

Parameters

8B

Published

Aug 12, 2024

P-LLama3 is an AI model developed by University of Siena (Italy), first published in August 2024. It works in the biology domain, on tasks such as protein generation and protein design.

Training it took an estimated 7.2×10²³ FLOP of compute (estimation method: operation counting). The model has 8,000,000,000 parameters. Training ran on 4 NVIDIA RTX A6000.

Access: Open weights (restricted use). Its weights are openly available. It is built on top of Llama 3-8B. The reference paper has 2 citations. Epoch AI rates the confidence of this record as confident.

Full record

Organization: University of Siena
Country of organization: Italy
Domain: Biology
Task: Protein generation, Protein design
Training compute: 7.2×10²³ FLOP
Compute estimation method: Operation counting
Parameters: 8,000,000,000
Training hardware: NVIDIA RTX A6000
Chips used: 4
Training power draw: 2.4 kW
Model accessibility: Open weights (restricted use)
Open weights: Yes
Base model: Llama 3-8B
Citations: 2
Epoch confidence: Confident