AI models
Falcon-7B
Training compute
6.3×10²² FLOP
Parameters
7B
Published
Apr 24, 2023
Falcon-7B is an AI model developed by Technology Innovation Institute (United Arab Emirates), first published in April 2023. It works in the language domain, on tasks such as language modeling/generation and question answering.
Training it took an estimated 6.3×10²² FLOP of compute (estimation method: operation counting,reported). The model has 7,000,000,000 parameters. It was trained on roughly 1.5T datapoints. Training ran on 384 NVIDIA A100 SXM4 40 GB.
Access: Open weights (unrestricted). Its weights are openly available. Epoch AI rates the confidence of this record as confident.
Full record
- Organization
- Technology Innovation Institute
- Country of organization
- United Arab Emirates
- Domain
- Language
- Task
- Language modeling/generation, Question answering
- Training compute
- 6.3×10²² FLOP
- Compute estimation method
- Operation counting, Reported
- Parameters
- 7,000,000,000
- Dataset size
- 1.5T
- Training hardware
- NVIDIA A100 SXM4 40 GB
- Chips used
- 384
- Training power draw
- 306.1 kW
- Model accessibility
- Open weights (unrestricted)
- Open weights
- Yes
- Epoch confidence
- Confident
Benchmark results
| 01 | Epoch Capabilities Index | ECI Score | 94.7 |
| 02 | PIQA | Score | 0.8 |
| 03 | HellaSwag | Overall accuracy | 0.78 |
| 04 | BoolQ | Score | 0.75 |
| 05 | LAMBADA | Score | 0.75 |
| 06 | WinoGrande | Accuracy | 0.67 |
| 07 | TriviaQA | EM | 0.65 |
| 08 | OpenBookQA | Accuracy | 0.52 |
More from Technology Innovation Institute
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models