AI models
Tulu V2 DPO 70B
Parameters
70B
Published
Nov 20, 2023
Tulu V2 DPO 70B is an AI model developed by Allen Institute for AI and University of Washington (United States), first published in November 2023. It works in the language domain, on tasks such as language modeling/generation and question answering.
Epoch AI has no training-compute estimate for this model. The model has 70,000,000,000 parameters. Training ran on 512 Google TPU v3 for about 168 hours.
Access: Open weights (restricted use). Its weights are openly available. It is built on top of Llama 2-70B. Epoch AI rates the confidence of this record as likely.
Full record
- Organization
- Allen Institute for AI, University of Washington
- Country of organization
- United States
- Domain
- Language
- Task
- Language modeling/generation, Question answering
- Compute estimation method
- Hardware, Operation counting
- Parameters
- 70,000,000,000
- Training hardware
- Google TPU v3
- Chips used
- 512
- Training time
- 168 h
- Training power draw
- 457.0 kW
- Numerical format
- BF16
- Model accessibility
- Open weights (restricted use)
- Open weights
- Yes
- Base model
- Llama 2-70B
- Epoch confidence
- Likely
More from Allen Institute for AI,University of Washington
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models