mini-GPT-2+Active-AdamW is an AI model developed by HEC Montreal (Canada), first published in January 2023. It works in the language domain, on tasks such as language modeling.
Epoch AI has no training-compute estimate for this model. Training ran on 1 NVIDIA V100,NVIDIA P100.
Access: Unreleased. Its weights are not openly released. Epoch AI rates the confidence of this record as confident.