ChatBit is an AI model developed by Beijing Institute of Technology, Academy of Military Science and Minzu University of China (China), first published in June 2024. It works in the language domain, on tasks such as chat and language modeling/generation.
Epoch AI has no training-compute estimate for this model. The model has 13,000,000,000 parameters. It was trained on roughly 100M datapoints. Training ran on 8 NVIDIA A100.
Access: Unreleased. Its weights are not openly released. It is built on top of LLaMA-13B. Epoch AI rates the confidence of this record as likely.