xGen-MM (BLIP-3) is an AI model developed by Salesforce Research and University of Washington (United States), first published in August 2024. It works in the multimodal, vision and language domain, on tasks such as image captioning, character recognition (ocr), visual question answering and chat.
Training it took an estimated 2.4×10²¹ FLOP of compute. The model has 4,000,000,000 parameters.
It is built on top of phi-3-mini 3.8B. The reference paper has 139 citations. Epoch AI rates the confidence of this record as confident.