Routing Transformer (WT-103)

Parameters

79.5M

Published

Mar 12, 2020

Routing Transformer (WT-103) is an AI model developed by Google Research (United States), first published in March 2020. It works in the language domain, on tasks such as language modeling.

Epoch AI has no training-compute estimate for this model. The model has 79,500,000 parameters. It was trained on roughly 103M datapoints.

Access: Open weights (unrestricted). Its weights are openly available. The reference paper has 754 citations. Epoch AI rates the confidence of this record as confident.

Full record

Organization: Google Research
Country of organization: United States
Domain: Language
Task: Language modeling
Parameters: 79,500,000
Dataset size: 103M
Model accessibility: Open weights (unrestricted)
Open weights: Yes
Citations: 754
Epoch confidence: Confident