DCTransformer (ImageNet)

Training compute

4.4×10²¹ FLOP

Parameters

736M

Published

Mar 5, 2021

DCTransformer (ImageNet) is an AI model developed by DeepMind (United Kingdom), first published in March 2021. It works in the image generation domain, on tasks such as image generation.

Training it took an estimated 4.4×10²¹ FLOP of compute (estimation method: operation counting). The model has 736,000,000 parameters. It was trained on roughly 1T datapoints. Training ran on 128 Google TPU v3.

Access: Unreleased. Its weights are not openly released. Epoch AI rates the confidence of this record as confident.

Full record

Organization: DeepMind
Country of organization: United Kingdom
Domain: Image generation
Task: Image generation
Training compute: 4.4×10²¹ FLOP
Compute estimation method: Operation counting
Parameters: 736,000,000
Dataset size: 1T
Training hardware: Google TPU v3
Chips used: 128
Training power draw: 116.8 kW
Model accessibility: Unreleased
Open weights: No
Epoch confidence: Confident