AI models
ADP-FAIRSEQ + NGRAMRES
Training compute
1.5×10¹⁷ FLOP
Parameters
247M
Published
Sep 28, 2018
ADP-FAIRSEQ + NGRAMRES is an AI model developed by Nara Institute of Science and Technology, Chinese University of Hong Kong (CUHK) and Tsinghua University (Japan, Hong Kong and China), first published in September 2018. It works in the language domain, on tasks such as language modeling.
Training it took an estimated 1.5×10¹⁷ FLOP of compute (estimation method: operation counting). The model has 247,000,000 parameters.
Access: Unreleased. Its weights are not openly released. It is built on top of Transformer (Adaptive Input Embeddings) WT103. The reference paper has 3 citations. Epoch AI rates the confidence of this record as speculative.
Full record
- Organization
- Nara Institute of Science and Technology, Chinese University of Hong Kong (CUHK), Tsinghua University
- Country of organization
- Japan, Hong Kong, China
- Domain
- Language
- Task
- Language modeling
- Training compute
- 1.5×10¹⁷ FLOP
- Compute estimation method
- Operation counting
- Parameters
- 247,000,000
- Model accessibility
- Unreleased
- Open weights
- No
- Base model
- Transformer (Adaptive Input Embeddings) WT103
- Citations
- 3
- Epoch confidence
- Speculative
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models