ViT + DINO is an AI model developed by INRIA and Facebook AI Research (France and United States), first published in April 2021. It works in the vision domain, on tasks such as image classification.
Training it took an estimated 2.1×10²⁰ FLOP of compute (estimation method: hardware). The model has 85,000,000 parameters. It was trained on roughly 1.3M datapoints. Training ran on NVIDIA V100. The compute alone is estimated at $380 in 2023 dollars.
Access: Open weights (unrestricted). Its weights are openly available. The reference paper has 9,037 citations. Epoch AI rates the confidence of this record as confident.