Janus 1.3B is an AI model developed by DeepSeek, The University of Hong Kong and Peking University (China and Hong Kong), first published in October 2024. It works in the language, vision and multimodal domain, on tasks such as language modeling/generation, question answering and visual question answering.
Epoch AI has no training-compute estimate for this model. The model has 1,300,000,000 parameters. Training ran on 16 NVIDIA A100 SXM4 40 GB for about 168 hours.
Access: Open weights (restricted use). Its weights are openly available. It is built on top of DeepSeek-LLM-1.3b-base. Epoch AI rates the confidence of this record as confident.