DiLoCoX (Qwen1.5-107B on WT-103) is an AI model developed by China Mobile and Zero Gravity Labs (0g AI) (China and United States), first published in June 2025. It works in the language domain, on tasks such as language modeling/generation and question answering.
Epoch AI has no training-compute estimate for this model. The model has 107,000,000,000 parameters. Training ran on 160 NVIDIA A800 PCIe 40 GB.
Access: Unreleased. Its weights are not openly released. Epoch AI rates the confidence of this record as confident.