tsuzumi 7B upgrade 2024 is an AI model developed by NTT Communication Science Laboratories (Japan), first published in April 2024. It works in the language, multimodal and vision domain, on tasks such as chat, language modeling/generation and document classification.
Training it took an estimated 4.2×10²² FLOP of compute (estimation method: operation counting). The model has 7,000,000,000 parameters. It was trained on roughly 1T datapoints.
Epoch AI rates the confidence of this record as likely.