OLMo-1B is an AI model developed by Allen Institute for AI and University of Washington (United States), first published in February 2024. It works in the language domain, on tasks such as language modeling/generation and chat.
Training it took an estimated 1.2×10²² FLOP of compute (estimation method: operation counting). The model has 1,000,000,000 parameters. It was trained on roughly 2T datapoints. Training ran on AMD Radeon Instinct MI250X,NVIDIA A100.
Access: Open weights (unrestricted). Its weights are openly available. Epoch AI rates the confidence of this record as confident.