Minitron 8B

Parameters

8.3B

Published

Nov 4, 2024

Minitron 8B is an AI model developed by NVIDIA (United States), first published in November 2024. It works in the language domain, on tasks such as language modeling/generation, chat and question answering.

Epoch AI has no training-compute estimate for this model. The model has 8,300,000,000 parameters. Training ran on 8 NVIDIA A100 SXM4 80 GB.

Access: Open weights (non-commercial). Its weights are openly available. It is built on top of Nemotron-4 15B. Epoch AI rates the confidence of this record as confident.

Full record

Organization: NVIDIA
Country of organization: United States
Domain: Language
Task: Language modeling/generation, Chat, Question answering
Compute estimation method: Operation counting
Parameters: 8,300,000,000
Training hardware: NVIDIA A100 SXM4 80 GB
Chips used: 8
Training power draw: 6.3 kW
Model accessibility: Open weights (non-commercial)
Open weights: Yes
Base model: Nemotron-4 15B
Epoch confidence: Confident