AI models
LLaDA
Parameters
8B
Published
Feb 14, 2025
LLaDA is an AI model developed by Renmin University of China and Ant Group (China), first published in February 2025. It works in the language domain, on tasks such as code generation and language modeling/generation.
Epoch AI has no training-compute estimate for this model. The model has 8,000,000,000 parameters. It was trained on roughly 2.3T datapoints. Training ran on NVIDIA H800 SXM5.
The reference paper has 631 citations. Epoch AI rates the confidence of this record as confident.
Full record
- Organization
- Renmin University of China, Ant Group
- Country of organization
- China
- Domain
- Language
- Task
- Code generation, Language modeling/generation
- Parameters
- 8,000,000,000
- Dataset size
- 2.3T
- Training hardware
- NVIDIA H800 SXM5
- Citations
- 631
- Epoch confidence
- Confident
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models