AraELECTRA

Training compute

2.6×10²⁰ FLOP

Parameters

136M

Published

Mar 7, 2021

AraELECTRA is an AI model developed by American University of Beirut (Lebanon), first published in March 2021. It works in the language domain, on tasks such as language modeling/generation and question answering.

Training it took an estimated 2.6×10²⁰ FLOP of compute (estimation method: operation counting,hardware). The model has 136,000,000 parameters. Training ran on 8 Google TPU v3 for about 576 hours.

Access: Open weights (unrestricted). Its weights are openly available. Epoch AI rates the confidence of this record as confident.

Full record

Organization: American University of Beirut
Country of organization: Lebanon
Domain: Language
Task: Language modeling/generation, Question answering
Training compute: 2.6×10²⁰ FLOP
Compute estimation method: Operation counting, Hardware
Parameters: 136,000,000
Training hardware: Google TPU v3
Chips used: 8
Training time: 576 h
Training power draw: 7.3 kW
Model accessibility: Open weights (unrestricted)
Open weights: Yes
Epoch confidence: Confident