AI models
Theseus 6/768
Parameters
66M
Published
Feb 7, 2020
Theseus 6/768 is an AI model developed by University of California San Diego, Beihang University and Microsoft (United States and China), first published in February 2020. It works in the language domain, on tasks such as text autocompletion.
Epoch AI has no training-compute estimate for this model. The model has 66,000,000 parameters. It was trained on roughly 393K datapoints. Training ran on NVIDIA V100.
Access: Open weights (unrestricted). Its weights are openly available. It is built on top of BERT-Large. The reference paper has 224 citations. Epoch AI rates the confidence of this record as confident.
Full record
- Organization
- University of California San Diego, Beihang University, Microsoft
- Country of organization
- United States, China
- Domain
- Language
- Task
- Text autocompletion
- Parameters
- 66,000,000
- Dataset size
- 393K
- Training hardware
- NVIDIA V100
- Model accessibility
- Open weights (unrestricted)
- Open weights
- Yes
- Base model
- BERT-Large
- Citations
- 224
- Epoch confidence
- Confident
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models