AI models
SantaCoder
Training compute
2.1×10²¹ FLOP
Parameters
1.1B
Published
Jan 9, 2023
SantaCoder is an AI model developed by Hugging Face, ServiceNow, Massachusetts Institute of Technology (MIT), Wellesley College, Saama, EleutherAI and 2 more (United States and China), first published in January 2023. It works in the language domain, on tasks such as code generation.
Training it took an estimated 2.1×10²¹ FLOP of compute (estimation method: hardware). The model has 1,100,000,000 parameters. Training ran on NVIDIA V100 for about 150 hours.
Access: Open weights (restricted use). Its weights are openly available. The reference paper has 238 citations. Epoch AI rates the confidence of this record as confident.
Full record
- Organization
- Hugging Face, ServiceNow, Massachusetts Institute of Technology (MIT), Wellesley College, Saama, EleutherAI, Huawei Noah's Ark Lab, Carnegie Mellon University (CMU)
- Country of organization
- United States, China
- Domain
- Language
- Task
- Code generation
- Training compute
- 2.1×10²¹ FLOP
- Compute estimation method
- Hardware
- Parameters
- 1,100,000,000
- Training hardware
- NVIDIA V100
- Training time
- 150 h
- Model accessibility
- Open weights (restricted use)
- Open weights
- Yes
- Citations
- 238
- Epoch confidence
- Confident
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models