NMST+GPT-2

Training compute

1.2×10²⁰ FLOP

Parameters

124M

Published

Oct 3, 2022

NMST+GPT-2 is an AI model developed by New York University (NYU) (United States), first published in October 2022. It works in the language domain, on tasks such as language modeling.

Training it took an estimated 1.2×10²⁰ FLOP of compute. The model has 124,000,000 parameters. It was trained on roughly 103M datapoints.

Access: Unreleased. Its weights are not openly released. It is built on top of GPT-2 (124M). Epoch AI rates the confidence of this record as confident.

Full record

Organization: New York University (NYU)
Country of organization: United States
Domain: Language
Task: Language modeling
Training compute: 1.2×10²⁰ FLOP
Parameters: 124,000,000
Dataset size: 103M
Model accessibility: Unreleased
Open weights: No
Base model: GPT-2 (124M)
Citations: 0
Epoch confidence: Confident