InstructGPT 175B

Training compute

3.2×10²³ FLOP

Parameters

175B

Published

Jan 27, 2022

InstructGPT 175B is an AI model developed by OpenAI (United States), first published in January 2022. It works in the language domain, on tasks such as language modeling/generation.

Training it took an estimated 3.2×10²³ FLOP of compute (estimation method: reported). The model has 175,000,000,000 parameters. It was trained on roughly 17M datapoints.

Access: API access. Its weights are not openly released. It is built on top of GPT-3 175B (davinci). The reference paper has 20,786 citations. Epoch AI rates the confidence of this record as confident.

Full record

Organization: OpenAI
Country of organization: United States
Domain: Language
Task: Language modeling/generation
Training compute: 3.2×10²³ FLOP
Compute estimation method: Reported
Parameters: 175,000,000,000
Dataset size: 17M
Model accessibility: API access
Open weights: No
Base model: GPT-3 175B (davinci)
Citations: 20,786
Epoch confidence: Confident