Llama-SEA-LION-v2-8B is an AI model, first published in July 2024.
Training it took an estimated 8.8×10²¹ FLOP of compute. The model has 8,000,000,000 parameters. It was trained on roughly 48B datapoints.
Epoch AI rates the confidence of this record as likely.