TaLK Convolution is an AI model developed by Carleton University (Canada), first published in February 2020. It works in the language domain, on tasks such as language modeling, translation and text summarization.
Training it took an estimated 2.7×10¹⁹ FLOP of compute (estimation method: operation counting). The model has 240,000,000 parameters. It was trained on roughly 103M datapoints. Training ran on 8 NVIDIA GeForce RTX 2080 Ti 11GB.
Access: Unreleased. Its weights are not openly released. The reference paper has 30 citations. Epoch AI rates the confidence of this record as likely.