retrieval-quality-kNN-LMs is an AI model developed by University of Massachusetts Amherst (United States), first published in October 2022. It works in the language domain, on tasks such as language modeling.
Epoch AI has no training-compute estimate for this model. The model has 247,000,000 parameters. It was trained on roughly 103M datapoints.
Access: Unreleased. Its weights are not openly released. It is built on top of Base LM + kNN LM + Continuous Cache. The reference paper has 15 citations.