Pharia-1-LLM-7B

Training compute

4.4×10²³ FLOP

Parameters

7B

Published

Aug 26, 2024

Pharia-1-LLM-7B is an AI model developed by Aleph Alpha (Germany), first published in August 2024. It works in the language domain, on tasks such as language modeling/generation, translation and question answering.

Training it took an estimated 4.4×10²³ FLOP of compute (estimation method: reported). The model has 7,041,544,704 parameters. Training ran on 256 NVIDIA A100 SXM4 80 GB,NVIDIA H100 SXM5 80GB.

Access: Open weights (non-commercial). Its weights are openly available. Epoch AI rates the confidence of this record as confident.

Full record

Organization: Aleph Alpha
Country of organization: Germany
Domain: Language
Task: Language modeling/generation, Translation, Question answering
Training compute: 4.4×10²³ FLOP
Compute estimation method: Reported
Parameters: 7,041,544,704
Training hardware: NVIDIA A100 SXM4 80 GB, NVIDIA H100 SXM5 80GB
Chips used: 256
Model accessibility: Open weights (non-commercial)
Open weights: Yes
Epoch confidence: Confident