AI models
Transformer-XL + PowerSGD + L-Greco
Training compute
1.3×10¹⁸ FLOP
Published
Oct 31, 2022
Transformer-XL + PowerSGD + L-Greco is an AI model developed by Institute of Science and Technology Austria (ISTA) and Neural Magic (Austria and United States), first published in October 2022. It works in the language domain, on tasks such as language modeling.
Training it took an estimated 1.3×10¹⁸ FLOP of compute (estimation method: hardware). It was trained on roughly 103M datapoints. Training ran on 8 NVIDIA GeForce RTX 3090 for about 4.28 hours.
Access: Unreleased. Its weights are not openly released. The reference paper has 4 citations. Epoch AI rates the confidence of this record as confident.
Full record
- Organization
- Institute of Science and Technology Austria (ISTA), Neural Magic
- Country of organization
- Austria, United States
- Domain
- Language
- Task
- Language modeling
- Training compute
- 1.3×10¹⁸ FLOP
- Compute estimation method
- Hardware
- Dataset size
- 103M
- Training hardware
- NVIDIA GeForce RTX 3090
- Chips used
- 8
- Training time
- 4 h
- Training power draw
- 5.6 kW
- Model accessibility
- Unreleased
- Open weights
- No
- Citations
- 4
- Epoch confidence
- Confident
More from Institute of Science and Technology Austria (ISTA),Neural Magic
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models