GRU + p-tHSM (pretrain via Brown) (WT103) is an AI model developed by Beihang University, University of Montreal / Université de Montréal and Chongqing University (China and Canada), first published in August 2017. It works in the language domain, on tasks such as language modeling.
Epoch AI has no training-compute estimate for this model. The model has 206,000,000 parameters.
Access: Unreleased. Its weights are not openly released. The reference paper has 6 citations.