AI models
InternViT-6B
Parameters
6B
Published
Jan 15, 2024
InternViT-6B is an AI model developed by Shanghai AI Lab, Nanjing University, The University of Hong Kong, Tsinghua University, SenseTime and University of Science and Technology of China (USTC) (China and Hong Kong), first published in January 2024. It works in the vision and language domain, on tasks such as visual question answering.
Epoch AI has no training-compute estimate for this model. The model has 6,000,000,000 parameters. Training ran on 640 NVIDIA A100.
It is built on top of LLaMA-7B. Epoch AI rates the confidence of this record as confident.
Full record
- Organization
- Shanghai AI Lab, Nanjing University, The University of Hong Kong, Tsinghua University, SenseTime, University of Science and Technology of China (USTC)
- Country of organization
- China, Hong Kong
- Domain
- Vision, Language
- Task
- Visual question answering
- Parameters
- 6,000,000,000
- Training hardware
- NVIDIA A100
- Chips used
- 640
- Training power draw
- 507.1 kW
- Base model
- LLaMA-7B
- Epoch confidence
- Confident
More from Shanghai AI Lab,Nanjing University,The University of Hong Kong,Tsinghua University,SenseTime,University of Science and Technology of China (USTC)
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models