GRU + p-tHSM (pretrain via Brown) (WT2) is an AI model developed by Beihang University, University of Montreal / Université de Montréal and Chongqing University (China and Canada), first published in August 2017. It works in the language domain, on tasks such as language modeling.
Epoch AI has no training-compute estimate for this model.
Access: Unreleased. Its weights are not openly released.