Transformer-XL+AdamGapAware(GA) is an AI model developed by Technion - Israel Institute of Technology (Israel), first published in September 2019. It works in the language domain, on tasks such as language modeling.
Epoch AI has no training-compute estimate for this model. The model has 257,000,000 parameters.
Access: Unreleased. Its weights are not openly released. The reference paper has 27 citations.