AI models
BGE-M3 Embedding
Parameters
335M
Published
Jan 30, 2024
BGE-M3 Embedding is an AI model developed by Beijing Academy of Artificial Intelligence / BAAI (China), first published in January 2024. It works in the language domain, on tasks such as language modeling/generation and translation.
Epoch AI has no training-compute estimate for this model. The model has 335,000,000 parameters. It was trained on roughly 1.2B datapoints. Training ran on NVIDIA A100,NVIDIA A800 PCIe 40 GB.
Access: Open weights (unrestricted). Its weights are openly available. It is built on top of XLM-RoBERTa. Epoch AI rates the confidence of this record as likely.
Full record
- Organization
- Beijing Academy of Artificial Intelligence / BAAI
- Country of organization
- China
- Domain
- Language
- Task
- Language modeling/generation, Translation
- Parameters
- 335,000,000
- Dataset size
- 1.2B
- Training hardware
- NVIDIA A100, NVIDIA A800 PCIe 40 GB
- Model accessibility
- Open weights (unrestricted)
- Open weights
- Yes
- Base model
- XLM-RoBERTa
- Epoch confidence
- Likely
More from Beijing Academy of Artificial Intelligence / BAAI
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models