StableLM-Base-Alpha-7B

Training compute

4.5×10²² FLOP

Parameters

6.9B

Published

Aug 5, 2023

StableLM-Base-Alpha-7B is an AI model developed by Stability AI (United Kingdom), first published in August 2023. It works in the language domain, on tasks such as language modeling.

Training it took an estimated 4.5×10²² FLOP of compute (estimation method: operation counting). The model has 6,890,209,280 parameters. It was trained on roughly 1.1T datapoints. Training ran on NVIDIA A100 SXM4 40 GB for about 392 hours.

Access: Open weights (unrestricted). Its weights are openly available. Epoch AI rates the confidence of this record as confident.

Full record

Organization: Stability AI
Country of organization: United Kingdom
Domain: Language
Task: Language modeling
Training compute: 4.5×10²² FLOP
Compute estimation method: Operation counting
Parameters: 6,890,209,280
Dataset size: 1.1T
Training hardware: NVIDIA A100 SXM4 40 GB
Training time: 392 h
Model accessibility: Open weights (unrestricted)
Open weights: Yes
Epoch confidence: Confident