AI models
ChunkLlama2-13B
Parameters
13B
Published
May 29, 2024
ChunkLlama2-13B is an AI model developed by Alibaba, The University of Hong Kong and Fudan University (China and Hong Kong), first published in May 2024. It works in the language domain, on tasks such as language modeling/generation and question answering.
Epoch AI has no training-compute estimate for this model. The model has 13,000,000,000 parameters. It was trained on roughly 256M datapoints. Training ran on NVIDIA A100 SXM4 80 GB.
Access: Unreleased. Its weights are not openly released. It is built on top of Llama 2-13B. Epoch AI rates the confidence of this record as confident.
Full record
- Organization
- Alibaba, The University of Hong Kong, Fudan University
- Country of organization
- China, Hong Kong
- Domain
- Language
- Task
- Language modeling/generation, Question answering
- Compute estimation method
- Hardware, Operation counting
- Parameters
- 13,000,000,000
- Dataset size
- 256M
- Training hardware
- NVIDIA A100 SXM4 80 GB
- Chip-hours
- 60
- Model accessibility
- Unreleased
- Open weights
- No
- Base model
- Llama 2-13B
- Epoch confidence
- Confident
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models