OPT-1.3B

Parameters

1.3B

Published

Jun 21, 2022

OPT-1.3B is an AI model developed by Meta AI (United States), first published in June 2022. It works in the language domain, on tasks such as language modeling, chat, language modeling/generation and question answering.

Epoch AI has no training-compute estimate for this model. The model has 1,300,000,000 parameters. It was trained on roughly 180B datapoints.

Access: Open weights (non-commercial). Its weights are openly available. The reference paper has 4,716 citations. Epoch AI rates the confidence of this record as confident.

Full record

Organization: Meta AI
Country of organization: United States
Domain: Language
Task: Language modeling, Chat, Language modeling/generation, Question answering
Parameters: 1,300,000,000
Dataset size: 180B
Model accessibility: Open weights (non-commercial)
Open weights: Yes
Citations: 4,716
Epoch confidence: Confident

Benchmark results

01	PIQA	Score	0.69
02	WinoGrande	Accuracy	0.61
03	BoolQ	Score	0.6
04	HellaSwag	Overall accuracy	0.41
05	OpenBookQA	Accuracy	0.24
06	ARC AI2	Challenge score	0.23