bilingual-gpt-neox-4b

Training compute

1.2×10²² FLOP

Parameters

3.8B

Published

Jul 31, 2023

bilingual-gpt-neox-4b is an AI model developed by rinna (Japan), first published in July 2023. It works in the language domain, on tasks such as language generation and translation.

Training it took an estimated 1.2×10²² FLOP of compute (estimation method: operation counting). The model has 3,800,000,000 parameters.

Access: Open weights (unrestricted). Its weights are openly available. Epoch AI rates the confidence of this record as likely.

Full record

Organization: rinna
Country of organization: Japan
Domain: Language
Task: Language generation, Translation
Training compute: 1.2×10²² FLOP
Compute estimation method: Operation counting
Parameters: 3,800,000,000
Model accessibility: Open weights (unrestricted)
Open weights: Yes
Epoch confidence: Likely