AI models
CT-MoS (PTB)
Parameters
24M
Published
Dec 25, 2020
CT-MoS (PTB) is an AI model developed by National Tsing Hua University and Google (Taiwan and United States), first published in December 2020. It works in the language domain, on tasks such as language modeling.
Epoch AI has no training-compute estimate for this model. The model has 24,000,000 parameters. It was trained on roughly 929K datapoints. Training ran on 1 NVIDIA GeForce GTX 1080.
Access: Unreleased. Its weights are not openly released. The reference paper has 36 citations. Epoch AI rates the confidence of this record as confident.
Full record
- Organization
- National Tsing Hua University, Google
- Country of organization
- Taiwan, United States
- Domain
- Language
- Task
- Language modeling
- Parameters
- 24,000,000
- Dataset size
- 929K
- Training hardware
- NVIDIA GeForce GTX 1080
- Chips used
- 1
- Training power draw
- 201 W
- Model accessibility
- Unreleased
- Open weights
- No
- Citations
- 36
- Epoch confidence
- Confident
More from National Tsing Hua University,Google
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models