KN-LM

Training compute

7.7×10¹⁷ FLOP

Parameters

21B

Published

Jun 22, 2007

KN-LM is an AI model developed by Google (United States), first published in June 2007. It works in the language domain, on tasks such as language modeling. It counts among the frontier models: the systems trained with the most compute of their moment.

Training it took an estimated 7.7×10¹⁷ FLOP of compute (estimation method: hardware). The model has 21,000,000,000 parameters. It was trained on roughly 31B datapoints.

Epoch AI rates the confidence of this record as likely.

Full record

Organization: Google
Country of organization: United States
Domain: Language
Task: Language modeling
Training compute: 7.7×10¹⁷ FLOP
Compute estimation method: Hardware
Parameters: 21,000,000,000
Dataset size: 31B
Chips used: 400
Training time: 48 h
Epoch confidence: Likely