DL scaling LM

Parameters

177M

Published

Dec 1, 2017

DL scaling LM is an AI model developed by Baidu (China), first published in December 2017. It works in the language domain, on tasks such as language modeling.

Epoch AI has no training-compute estimate for this model. The model has 177,000,000 parameters. It was trained on roughly 400M datapoints.

Access: Unreleased. Its weights are not openly released. Epoch AI rates the confidence of this record as speculative.

Full record

Organization: Baidu
Country of organization: China
Domain: Language
Task: Language modeling
Parameters: 177,000,000
Dataset size: 400M
Model accessibility: Unreleased
Open weights: No
Epoch confidence: Speculative