ViT-G/14 (LiT)

Parameters

3B

Published

Nov 15, 2021

ViT-G/14 (LiT) is an AI model developed by Google Research (United States), first published in November 2021. It works in the vision domain, on tasks such as image classification.

Epoch AI has no training-compute estimate for this model. The model has 3,005,000,000 parameters. It was trained on roughly 1T datapoints. Training ran on Google TPU v3.

Access: Unreleased. Its weights are not openly released. It is built on top of ViT-G/14. The reference paper has 723 citations. Epoch AI rates the confidence of this record as confident.

Full record

Organization: Google Research
Country of organization: United States
Domain: Vision
Task: Image classification
Parameters: 3,005,000,000
Dataset size: 1T
Training hardware: Google TPU v3
Model accessibility: Unreleased
Open weights: No
Base model: ViT-G/14
Citations: 723
Epoch confidence: Confident