LightOn Mini

Training compute

2.4×10²³ FLOP

Parameters

40B

Published

Mar 21, 2023

LightOn Mini is an AI model developed by LightOn (France), first published in March 2023. It works in the language domain, on tasks such as language modeling/generation and chat.

Training it took an estimated 2.4×10²³ FLOP of compute (estimation method: operation counting). The model has 40,000,000,000 parameters. It was trained on roughly 1T datapoints.

Access: Hosted access (no API). Its weights are not openly released. Epoch AI rates the confidence of this record as confident.

Full record

Organization: LightOn
Country of organization: France
Domain: Language
Task: Language modeling/generation, Chat
Training compute: 2.4×10²³ FLOP
Compute estimation method: Operation counting
Parameters: 40,000,000,000
Dataset size: 1T
Model accessibility: Hosted access (no API)
Open weights: No
Epoch confidence: Confident