CRYSTALCODER
CRYSTALCODER is an AI model developed by Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), Petuum, University of Southern California, Carnegie Mellon University (CMU), University of Illinois Urbana-Champaign (UIUC), University of California San Diego and LLM360 (United Arab Emirates and United States), first published in December 2023. It works in the language domain, on tasks such as language modeling/generation, question answering and code generation.
Training it took an estimated 5.6×10²² FLOP of compute (estimation method: operation counting). The model has 6,700,000,000 parameters. It was trained on roughly 1.4T datapoints.
Access: Open weights (unrestricted). Its weights are openly available. Epoch AI rates the confidence of this record as confident.
- Organization
- Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), Petuum, University of Southern California, Carnegie Mellon University (CMU), University of Illinois Urbana-Champaign (UIUC), University of California San Diego, LLM360
- Country of organization
- United Arab Emirates, United States
- Domain
- Language
- Task
- Language modeling/generation, Question answering, Code generation
- Training compute
- 5.6×10²² FLOP
- Compute estimation method
- Operation counting
- Parameters
- 6,700,000,000
- Dataset size
- 1.4T
- Model accessibility
- Open weights (unrestricted)
- Open weights
- Yes
- Epoch confidence
- Confident