AI models
OmniFusion-7B (InternViT-6B-448px V1-2)
Parameters
12.5B
Published
Nov 22, 2023
OmniFusion-7B (InternViT-6B-448px V1-2) is an AI model developed by AIRI Artificial Intelligence Research Institute, Sber and Skolkovo Institute of Science and Technology (Russia), first published in November 2023. It works in the multimodal, vision and language domain, on tasks such as visual question answering, language modeling/generation and question answering.
Epoch AI has no training-compute estimate for this model. The model has 12,540,000,000 parameters. Training ran on 8 NVIDIA A100.
Access: Open weights (unrestricted). Its weights are openly available. It is built on top of InternViT-6B,GigaChat-7B. The reference paper has 7 citations. Epoch AI rates the confidence of this record as confident.
Full record
- Organization
- AIRI Artificial Intelligence Research Institute, Sber, Skolkovo Institute of Science and Technology
- Country of organization
- Russia
- Domain
- Multimodal, Vision, Language
- Task
- Visual question answering, Language modeling/generation, Question answering
- Parameters
- 12,540,000,000
- Training hardware
- NVIDIA A100
- Chips used
- 8
- Training power draw
- 6.3 kW
- Model accessibility
- Open weights (unrestricted)
- Open weights
- Yes
- Base model
- InternViT-6B, GigaChat-7B
- Citations
- 7
- Epoch confidence
- Confident
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models