Hybrid H3-1.3B is an AI model developed by Stanford University and University at Buffalo (United States), first published in December 2022. It works in the language domain, on tasks such as language modeling/generation.
Epoch AI has no training-compute estimate for this model. The model has 1,300,000,000 parameters. It was trained on roughly 400B datapoints. Training ran on 8 NVIDIA A100.
Access: Open weights (unrestricted). Its weights are openly available. The reference paper has 636 citations. Epoch AI rates the confidence of this record as confident.