MobileBERT is an AI model developed by Carnegie Mellon University (CMU) and Google Brain (United States), first published in April 2020. It works in the language domain, on tasks such as text autocompletion and language modeling/generation.
Epoch AI has no training-compute estimate for this model. The model has 25,300,000 parameters.
Access: Open weights (unrestricted). Its weights are openly available. The reference paper has 1,011 citations.