Yi-Large

Training compute

1.8×10²⁴ FLOP

Parameters

100B

Published

May 13, 2024

Yi-Large is an AI model developed by 01.AI (China), first published in May 2024. It works in the language domain, on tasks such as chat and language modeling/generation.

Training it took an estimated 1.8×10²⁴ FLOP of compute (estimation method: operation counting). The model has 100,000,000,000 parameters. It was trained on roughly 3T datapoints.

Access: API access. Its weights are not openly released. Epoch AI rates the confidence of this record as speculative.

Full record

Organization: 01.AI
Country of organization: China
Domain: Language
Task: Chat, Language modeling/generation
Training compute: 1.8×10²⁴ FLOP
Compute estimation method: Operation counting
Parameters: 100,000,000,000
Dataset size: 3T
Numerical format: FP8
Model accessibility: API access
Open weights: No
Epoch confidence: Speculative

Benchmark results

01

MMLU

0.79