Live
AI models

Hybrid H3-1.3B

Parameters
1.3B
Published
Dec 28, 2022

Hybrid H3-1.3B is an AI model developed by Stanford University and University at Buffalo (United States), first published in December 2022. It works in the language domain, on tasks such as language modeling/generation.

Epoch AI has no training-compute estimate for this model. The model has 1,300,000,000 parameters. It was trained on roughly 400B datapoints. Training ran on 8 NVIDIA A100.

Access: Open weights (unrestricted). Its weights are openly available. The reference paper has 636 citations. Epoch AI rates the confidence of this record as confident.

Full record
Organization
Stanford University, University at Buffalo
Country of organization
United States
Domain
Language
Task
Language modeling/generation
Parameters
1,300,000,000
Dataset size
400B
Training hardware
NVIDIA A100
Chips used
8
Training power draw
6.4 kW
Model accessibility
Open weights (unrestricted)
Open weights
Yes
Citations
636
Epoch confidence
Confident
More from Stanford University,University at Buffalo
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models