AI models
Mamba-2.8B
Training compute
5.4×10²¹ FLOP
Parameters
2.8B
Published
Dec 1, 2023
Mamba-2.8B is an AI model developed by Carnegie Mellon University (CMU) and Princeton University (United States), first published in December 2023. It works in the language domain, on tasks such as language generation and question answering.
Training it took an estimated 5.4×10²¹ FLOP of compute (estimation method: operation counting). The model has 2,800,000,000 parameters. It was trained on roughly 300B datapoints.
Access: Open weights (unrestricted). Its weights are openly available. The reference paper has 7,063 citations. Epoch AI rates the confidence of this record as likely.
Full record
- Organization
- Carnegie Mellon University (CMU), Princeton University
- Country of organization
- United States
- Domain
- Language
- Task
- Language generation, Question answering
- Training compute
- 5.4×10²¹ FLOP
- Compute estimation method
- Operation counting
- Parameters
- 2,800,000,000
- Dataset size
- 300B
- Model accessibility
- Open weights (unrestricted)
- Open weights
- Yes
- Citations
- 7,063
- Epoch confidence
- Likely
More from Carnegie Mellon University (CMU),Princeton University
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models