CodeT5+

Parameters

16B

Published

May 20, 2023

CodeT5+ is an AI model developed by Salesforce (United States), first published in May 2023. It works in the language domain, on tasks such as code generation and code autocompletion.

Epoch AI has no training-compute estimate for this model. The model has 16,000,000,000 parameters. It was trained on roughly 51.5B datapoints. Training ran on NVIDIA A100.

Access: Open weights (unrestricted). Its weights are openly available. The reference paper has 699 citations. Epoch AI rates the confidence of this record as confident.

Full record

Organization: Salesforce
Country of organization: United States
Domain: Language
Task: Code generation, Code autocompletion
Parameters: 16,000,000,000
Dataset size: 51.5B
Training hardware: NVIDIA A100
Numerical format: FP16
Model accessibility: Open weights (unrestricted)
Open weights: Yes
Citations: 699
Epoch confidence: Confident