M6-10T

Training compute

5.5×10²¹ FLOP

Parameters

10T

Published

Oct 8, 2021

M6-10T is an AI model developed by Alibaba (China), first published in October 2021. It works in the multimodal, language and vision domain, on tasks such as language modeling/generation.

Training it took an estimated 5.5×10²¹ FLOP of compute (estimation method: hardware). The model has 10,000,000,000,000 parameters.

Access: Unreleased. Its weights are not openly released. The reference paper has 47 citations. Epoch AI rates the confidence of this record as confident.

Full record

Organization: Alibaba
Country of organization: China
Domain: Multimodal, Language, Vision
Task: Language modeling/generation
Training compute: 5.5×10²¹ FLOP
Compute estimation method: Hardware
Parameters: 10,000,000,000,000
Model accessibility: Unreleased
Open weights: No
Citations: 47
Epoch confidence: Confident