Llama-3.1-Minitron-4B

Parameters

4B

Published

Nov 4, 2024

Llama-3.1-Minitron-4B is an AI model developed by NVIDIA (United States), first published in November 2024. It works in the language domain, on tasks such as language modeling/generation, chat and question answering.

Epoch AI has no training-compute estimate for this model. The model has 4,000,000,000 parameters. Training ran on 8 NVIDIA A100 SXM4 80 GB.

Access: Open weights (unrestricted). Its weights are openly available. It is built on top of Llama 3.1-8B. Epoch AI rates the confidence of this record as confident.

Full record

Organization: NVIDIA
Country of organization: United States
Domain: Language
Task: Language modeling/generation, Chat, Question answering
Parameters: 4,000,000,000
Training hardware: NVIDIA A100 SXM4 80 GB
Chips used: 8
Training power draw: 6.3 kW
Model accessibility: Open weights (unrestricted)
Open weights: Yes
Base model: Llama 3.1-8B
Epoch confidence: Confident