DeBERTaV3large + KEAR

Parameters

418M

Published

May 4, 2022

DeBERTaV3large + KEAR is an AI model developed by Microsoft (United States), first published in May 2022. It works in the language domain, on tasks such as question answering and language modeling/generation.

Epoch AI has no training-compute estimate for this model. The model has 418,000,000 parameters.

Access: Unreleased. Its weights are not openly released. It is built on top of DeBERTaV3large. The reference paper has 63 citations. Epoch AI rates the confidence of this record as confident.

Full record

Organization: Microsoft
Country of organization: United States
Domain: Language
Task: Question answering, Language modeling/generation
Parameters: 418,000,000
Model accessibility: Unreleased
Open weights: No
Base model: DeBERTaV3large
Citations: 63
Epoch confidence: Confident