Microsoft MAI-1 (2024 unreleased)

Training compute

1.6×10²² FLOP

Parameters

500B

Published

May 6, 2024

Microsoft MAI-1 (2024 unreleased) is an AI model developed by Microsoft (United States), first published in May 2024. It works in the language domain, on tasks such as language modeling and language modeling/generation.

Training it took an estimated 1.6×10²² FLOP of compute. The model has 500,000,000,000 parameters. Training ran on NVIDIA H100 SXM5 80GB.

Access: Hosted access (no API). Its weights are not openly released. Epoch AI rates the confidence of this record as confident.

Full record

Organization: Microsoft
Country of organization: United States
Domain: Language
Task: Language modeling, Language modeling/generation
Training compute: 1.6×10²² FLOP
Parameters: 500,000,000,000
Training hardware: NVIDIA H100 SXM5 80GB
Chip-hours: 15K
Model accessibility: Hosted access (no API)
Open weights: No
Epoch confidence: Confident