CodeGeeX is an AI model developed by Z.ai (Zhipu AI) and Tsinghua University (China), first published in June 2022. It works in the language domain, on tasks such as code generation.
Training it took an estimated 6.6×10²² FLOP of compute (estimation method: operation counting). The model has 13,000,000,000 parameters. It was trained on roughly 850B datapoints. Training ran on Huawei Ascend 910 for about 156 hours.
Access: Open weights (restricted use). Its weights are openly available. Epoch AI rates the confidence of this record as confident.