AI models
ALBERT
Parameters
18M
Published
Sep 26, 2019
ALBERT is an AI model developed by Toyota Technological Institute at Chicago and Google Research (United States), first published in September 2019. It works in the language domain, on tasks such as language modeling/generation and question answering.
Epoch AI has no training-compute estimate for this model. The model has 18,000,000 parameters. It was trained on roughly 3.3B datapoints. Training ran on Google TPU v3.
Access: Open weights (unrestricted). Its weights are openly available. The reference paper has 7,447 citations. Epoch AI rates the confidence of this record as confident.
Full record
- Organization
- Toyota Technological Institute at Chicago, Google Research
- Country of organization
- United States
- Domain
- Language
- Task
- Language modeling/generation, Question answering
- Parameters
- 18,000,000
- Dataset size
- 3.3B
- Training hardware
- Google TPU v3
- Model accessibility
- Open weights (unrestricted)
- Open weights
- Yes
- Citations
- 7,447
- Epoch confidence
- Confident
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models