Gopher (7.1B)

Parameters

7.1B

Published

Dec 8, 2021

Gopher (7.1B) is an AI model developed by DeepMind (United Kingdom), first published in December 2021. It works in the language domain, on tasks such as language modeling/generation.

Epoch AI has no training-compute estimate for this model. The model has 7,100,000,000 parameters. It was trained on roughly 300M datapoints.

Access: Unreleased. Its weights are not openly released. The reference paper has 1,605 citations. Epoch AI rates the confidence of this record as confident.

Full record

Organization: DeepMind
Country of organization: United Kingdom
Domain: Language
Task: Language modeling/generation
Parameters: 7,100,000,000
Dataset size: 300M
Model accessibility: Unreleased
Open weights: No
Citations: 1,605
Epoch confidence: Confident