Verbatim Memory Transformer (117M) is an AI model developed by Johns Hopkins University and New York University (NYU) (United States), first published in October 2022. It works in the language domain, on tasks such as language modeling.
Epoch AI has no training-compute estimate for this model. The model has 117,000,000 parameters. It was trained on roughly 10.7B datapoints.
Access: Unreleased. Its weights are not openly released. The reference paper has 9 citations. Epoch AI rates the confidence of this record as confident.