TransfoRNN(d=1024)(2-layer) (WT2)

Parameters

97.6M

Published

Apr 4, 2021

TransfoRNN(d=1024)(2-layer) (WT2) is an AI model developed by Lenovo Research (China), first published in April 2021. It works in the language domain, on tasks such as language modeling.

Epoch AI has no training-compute estimate for this model. The model has 97,600,000 parameters.

Access: Unreleased. Its weights are not openly released.

Full record

Organization: Lenovo Research
Country of organization: China
Domain: Language
Task: Language modeling
Parameters: 97,600,000
Model accessibility: Unreleased
Open weights: No
Citations: 0