BELLE-LLaMA-EXT-7B is an AI model developed by KE Holdings Inc. (“Beike”) (China), first published in April 2023. It works in the language domain, on tasks such as language modeling/generation.
Epoch AI has no training-compute estimate for this model. The model has 7,000,000,000 parameters. It was trained on roughly 3.4B datapoints. Training ran on 8 NVIDIA A100 SXM4 80 GB.
Access: Open weights (non-commercial). Its weights are openly available. It is built on top of LLaMA-7B. Epoch AI rates the confidence of this record as confident.