TAIWAN-LLM 7B

Parameters

7B

Published

Nov 23, 2023

TAIWAN-LLM 7B is an AI model developed by National Taiwan University (Taiwan), first published in November 2023. It works in the language domain, on tasks such as chat.

Epoch AI has no training-compute estimate for this model. The model has 7,000,000,000 parameters. Training ran on 48 NVIDIA H100 SXM5 80GB.

It is built on top of Llama 2-7B. The reference paper has 34 citations. Epoch AI rates the confidence of this record as confident.

Full record

Organization: National Taiwan University
Country of organization: Taiwan
Domain: Language
Task: Chat
Parameters: 7,000,000,000
Training hardware: NVIDIA H100 SXM5 80GB
Chips used: 48
Training power draw: 66.6 kW
Base model: Llama 2-7B
Citations: 34
Epoch confidence: Confident