Tensorized Transformer (large PTB) is an AI model developed by Tianjin University, Microsoft Research Asia and Beijing Institute of Technology (China), first published in June 2019. It works in the language domain, on tasks such as language modeling and translation.
Epoch AI has no training-compute estimate for this model. Training ran on 2 NVIDIA P40.
Access: Unreleased. Its weights are not openly released. The reference paper has 194 citations. Epoch AI rates the confidence of this record as confident.