Multilingual-E5-large

Training compute

3.4×10¹⁸ FLOP

Parameters

560M

Published

Jun 30, 2023

Multilingual-E5-large is an AI model developed by Microsoft (United States), first published in June 2023. It works in the language domain, on tasks such as semantic embedding.

Training it took an estimated 3.4×10¹⁸ FLOP of compute (estimation method: operation counting). The model has 560,000,000 parameters. It was trained on roughly 1B datapoints.

Access: Open weights (unrestricted). Its weights are openly available. Epoch AI rates the confidence of this record as likely.

Full record

Organization: Microsoft
Country of organization: United States
Domain: Language
Task: Semantic embedding
Training compute: 3.4×10¹⁸ FLOP
Compute estimation method: Operation counting
Parameters: 560,000,000
Dataset size: 1B
Model accessibility: Open weights (unrestricted)
Open weights: Yes
Epoch confidence: Likely