CodeGen-Mono 16.1B

Parameters

16.1B

Published

Feb 27, 2023

CodeGen-Mono 16.1B is an AI model developed by Salesforce (United States), first published in February 2023. It works in the language domain, on tasks such as code generation and code autocompletion.

Epoch AI has no training-compute estimate for this model. The model has 16,100,000,000 parameters. It was trained on roughly 71.7B datapoints. Training ran on Google TPU v4.

Access: Open weights (unrestricted). Its weights are openly available. The reference paper has 1,473 citations. Epoch AI rates the confidence of this record as likely.

Full record

Organization: Salesforce
Country of organization: United States
Domain: Language
Task: Code generation, Code autocompletion
Parameters: 16,100,000,000
Dataset size: 71.7B
Training hardware: Google TPU v4
Model accessibility: Open weights (unrestricted)
Open weights: Yes
Citations: 1,473
Epoch confidence: Likely