AI models
Falcon3-7B
Training compute
5.9×10²³ FLOP
Parameters
7B
Published
Dec 17, 2024
Falcon3-7B is an AI model developed by Technology Innovation Institute (United Arab Emirates), first published in December 2024. It works in the language domain, on tasks such as language modeling/generation, question answering and code generation.
Training it took an estimated 5.9×10²³ FLOP of compute (estimation method: operation counting). The model has 7,000,000,000 parameters. It was trained on roughly 14T datapoints. Training ran on 1,024 NVIDIA H100 SXM5 80GB.
Access: Open weights (unrestricted). Its weights are openly available. Epoch AI rates the confidence of this record as confident.
Full record
- Organization
- Technology Innovation Institute
- Country of organization
- United Arab Emirates
- Domain
- Language
- Task
- Language modeling/generation, Question answering, Code generation
- Training compute
- 5.9×10²³ FLOP
- Compute estimation method
- Operation counting
- Parameters
- 7,000,000,000
- Dataset size
- 14T
- Training hardware
- NVIDIA H100 SXM5 80GB
- Chips used
- 1,024
- Training power draw
- 1.4 MW
- Model accessibility
- Open weights (unrestricted)
- Open weights
- Yes
- Epoch confidence
- Confident
More from Technology Innovation Institute
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models