AI models
Aya
Parameters
13B
Published
Feb 12, 2024
Aya is an AI model developed by Cohere for AI, Brown University, Cohere, Carnegie Mellon University (CMU) and Massachusetts Institute of Technology (MIT) (Canada and United States), first published in February 2024. It works in the language domain, on tasks such as language modeling/generation, chat and translation.
Epoch AI has no training-compute estimate for this model. The model has 13,000,000,000 parameters. It was trained on roughly 1.1T datapoints. Training ran on 128 Google TPU v4.
Access: Open weights (unrestricted). Its weights are openly available. It is built on top of mT5-XXL. The reference paper has 368 citations. Epoch AI rates the confidence of this record as speculative.
Full record
- Organization
- Cohere for AI, Brown University, Cohere, Carnegie Mellon University (CMU), Massachusetts Institute of Technology (MIT)
- Country of organization
- Canada, United States
- Domain
- Language
- Task
- Language modeling/generation, Chat, Translation
- Parameters
- 13,000,000,000
- Dataset size
- 1.1T
- Training hardware
- Google TPU v4
- Chips used
- 128
- Training power draw
- 86.2 kW
- Model accessibility
- Open weights (unrestricted)
- Open weights
- Yes
- Base model
- mT5-XXL
- Citations
- 368
- Epoch confidence
- Speculative
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models