Trillion-7B

Training compute

9.3×10²² FLOP

Parameters

7B

Published

Apr 21, 2025

Trillion-7B is an AI model developed by Trillion Labs (South Korea), first published in April 2025. It works in the language domain, on tasks such as language modeling/generation, question answering, code generation and quantitative reasoning.

Training it took an estimated 9.3×10²² FLOP of compute (estimation method: reported,operation counting,hardware). The model has 7,000,000,000 parameters. It was trained on roughly 2T datapoints. Training ran on 256 NVIDIA H100 SXM5 80GB. The compute alone is estimated at $139K in 2023 dollars.

Access: Open weights (unrestricted). Its weights are openly available. Epoch AI rates the confidence of this record as confident.

Full record

Organization: Trillion Labs
Country of organization: South Korea
Domain: Language
Task: Language modeling/generation, Question answering, Code generation, Quantitative reasoning
Training compute: 9.3×10²² FLOP
Compute estimation method: Reported, Operation counting, Hardware
Parameters: 7,000,000,000
Dataset size: 2T
Training hardware: NVIDIA H100 SXM5 80GB
Chips used: 256
Chip-hours: 59.4K
Training power draw: 351.3 kW
Training cost (2023 USD): $139K
Numerical format: BF16
Model accessibility: Open weights (unrestricted)
Open weights: Yes
Epoch confidence: Confident