AI models
Adaptive Inputs + LayerDrop
Parameters
423M
Published
Sep 25, 2019
Adaptive Inputs + LayerDrop is an AI model developed by Facebook AI Research and LORIA (United States and France), first published in September 2019. It works in the language domain, on tasks such as language modeling/generation, translation, question answering and 2 more.
Epoch AI has no training-compute estimate for this model. The model has 423,000,000 parameters. It was trained on roughly 103M datapoints.
Access: Open weights (unrestricted). Its weights are openly available. The reference paper has 702 citations. Epoch AI rates the confidence of this record as confident.
Full record
- Organization
- Facebook AI Research, LORIA
- Country of organization
- United States, France
- Domain
- Language
- Task
- Language modeling/generation, Translation, Question answering, Text summarization, Language modeling
- Parameters
- 423,000,000
- Dataset size
- 103M
- Model accessibility
- Open weights (unrestricted)
- Open weights
- Yes
- Citations
- 702
- Epoch confidence
- Confident
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models