Yi 6B

Training compute

1.3×10²³ FLOP

Parameters

6B

Published

Nov 2, 2023

Yi 6B is an AI model developed by 01.AI (China), first published in November 2023. It works in the language domain, on tasks such as chat, language modeling/generation, translation and code generation.

Training it took an estimated 1.3×10²³ FLOP of compute (estimation method: operation counting). The model has 6,000,000,000 parameters.

Access: Open weights (restricted use). Its weights are openly available. Epoch AI rates the confidence of this record as confident.

Full record

Organization: 01.AI
Country of organization: China
Domain: Language
Task: Chat, Language modeling/generation, Translation, Code generation
Training compute: 1.3×10²³ FLOP
Compute estimation method: Operation counting
Parameters: 6,000,000,000
Model accessibility: Open weights (restricted use)
Open weights: Yes
Epoch confidence: Confident

Benchmark results

01	Epoch Capabilities Index	ECI Score	104.5
02	HellaSwag	Overall accuracy	0.74
03	WinoGrande	Accuracy	0.71
04	MMLU	EM	0.64
05	ARC AI2	Challenge score	0.5
06	BIG-Bench Hard	Average	0.43
07	GSM8K	EM	0.33