MT-DNN

Parameters

330M

Published

Jan 31, 2019

MT-DNN is an AI model developed by Microsoft (United States), first published in January 2019. It works in the language domain, on tasks such as language modeling.

Epoch AI has no training-compute estimate for this model. The model has 330,000,000 parameters. It was trained on roughly 1M datapoints.

Access: Open weights (unrestricted). Its weights are openly available. The reference paper has 1,350 citations. Epoch AI rates the confidence of this record as confident.

Full record

Organization: Microsoft
Country of organization: United States
Domain: Language
Task: Language modeling
Parameters: 330,000,000
Dataset size: 1M
Numerical format: FP16
Model accessibility: Open weights (unrestricted)
Open weights: Yes
Citations: 1,350
Epoch confidence: Confident