Goat-7B is an AI model developed by National University of Singapore (Singapore), first published in May 2023. It works in the language domain, on tasks such as quantitative reasoning.
Epoch AI has no training-compute estimate for this model. The model has 7,000,000,000 parameters. It was trained on roughly 43.7M datapoints. Training ran on NVIDIA A10 PCIe.
Access: Open weights (non-commercial). Its weights are openly available. It is built on top of LLaMA-7B. The reference paper has 107 citations. Epoch AI rates the confidence of this record as speculative.