Fugaku-LLM is an AI model developed by Tohoku University, CyberAgent, Tokyo Institute of Technology, Fujitsu, RIKEN, Nagoya University and Kotoba Technologies (Japan), first published in May 2024. It works in the language domain, on tasks such as language modeling, translation, japanese language modeling and 2 more.
Training it took an estimated 3×10²² FLOP of compute (estimation method: operation counting). The model has 13,000,000,000 parameters. It was trained on roughly 380B datapoints.
Access: Open weights (unrestricted). Its weights are openly available. Epoch AI rates the confidence of this record as confident.