SmolLM-1.7B is an AI model, first published in July 2024. It works in the language domain, on tasks such as chat, question answering and language modeling/generation.
Training it took an estimated 10²² FLOP of compute (estimation method: operation counting). The model has 1,710,000,000 parameters. Training ran on 64 NVIDIA H100 PCIe.
Access: Open weights (unrestricted). Its weights are openly available. Epoch AI rates the confidence of this record as confident.