AI models
base LM+GNN (WT103)
Parameters
247M
Published
Oct 17, 2021
base LM+GNN (WT103) is an AI model developed by Shannon.AI, Nanjing University, Nanyang Technological University and Zhejiang University (ZJU) (China and Singapore), first published in October 2021. It works in the language domain, on tasks such as language modeling.
Epoch AI has no training-compute estimate for this model. The model has 247,000,000 parameters. It was trained on roughly 103M datapoints.
Access: Unreleased. Its weights are not openly released. It is built on top of Transformer (Adaptive Input Embeddings) WT103. The reference paper has 46 citations. Epoch AI rates the confidence of this record as confident.
Full record
- Organization
- Shannon.AI, Nanjing University, Nanyang Technological University, Zhejiang University (ZJU)
- Country of organization
- China, Singapore
- Domain
- Language
- Task
- Language modeling
- Parameters
- 247,000,000
- Dataset size
- 103M
- Model accessibility
- Unreleased
- Open weights
- No
- Base model
- Transformer (Adaptive Input Embeddings) WT103
- Citations
- 46
- Epoch confidence
- Confident
More from Shannon.AI,Nanjing University,Nanyang Technological University,Zhejiang University (ZJU)
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models