AI models
Xinyu
Parameters
13B
Published
Aug 23, 2024
Xinyu is an AI model developed by Zhejiang University (ZJU), Institute for Advanced Algorithms Research, Northeastern University (China), China Telecom and State Key Laboratory of Media Convergence Production Technology and Systems (China), first published in August 2024. It works in the language domain, on tasks such as language modeling/generation.
Epoch AI has no training-compute estimate for this model. The model has 13,000,000,000 parameters. It was trained on roughly 500M datapoints. Training ran on 128 NVIDIA A800 PCIe 80 GB for about 528 hours.
Access: Unreleased. Its weights are not openly released. It is built on top of Llama 2-13B. The reference paper has 5 citations. Epoch AI rates the confidence of this record as confident.
Full record
- Organization
- Zhejiang University (ZJU), Institute for Advanced Algorithms Research, Northeastern University (China), China Telecom, State Key Laboratory of Media Convergence Production Technology and Systems
- Country of organization
- China
- Domain
- Language
- Task
- Language modeling/generation
- Compute estimation method
- Hardware, Operation counting
- Parameters
- 13,000,000,000
- Dataset size
- 500M
- Training hardware
- NVIDIA A800 PCIe 80 GB
- Chips used
- 128
- Training time
- 528 h
- Training power draw
- 63.1 kW
- Model accessibility
- Unreleased
- Open weights
- No
- Base model
- Llama 2-13B
- Citations
- 5
- Epoch confidence
- Confident
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models