AI models
Weight Decay
Training compute
7.5×10¹⁰ FLOP
Parameters
8.4K
Published
Dec 2, 1991
Weight Decay is an AI model, first published in December 1991. It works in the speech domain, on tasks such as speech synthesis. It counts among the frontier models: the systems trained with the most compute of their moment.
Training it took an estimated 7.5×10¹⁰ FLOP of compute (estimation method: operation counting). The model has 8,386 parameters. It was trained on roughly 25K datapoints.
Epoch AI rates the confidence of this record as confident.
Full record
- Domain
- Speech
- Task
- Speech synthesis
- Training compute
- 7.5×10¹⁰ FLOP
- Compute estimation method
- Operation counting
- Parameters
- 8,386
- Dataset size
- 25K
- Epoch confidence
- Confident
More ai models
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models