WizardLM-2 8x22B

Parameters

141B

Published

Apr 15, 2024

WizardLM-2 8x22B is an AI model developed by Microsoft (United States), first published in April 2024. It works in the language domain, on tasks such as language modeling/generation and question answering.

Epoch AI has no training-compute estimate for this model. The model has 141,000,000,000 parameters.

Access: Open weights (unrestricted). Its weights are openly available. It is built on top of Mixtral 8x22B. Epoch AI rates the confidence of this record as confident.

Full record

Organization: Microsoft
Country of organization: United States
Domain: Language
Task: Language modeling/generation, Question answering
Parameters: 141,000,000,000
Model accessibility: Open weights (unrestricted)
Open weights: Yes
Base model: Mixtral 8x22B
Epoch confidence: Confident

Benchmark results

01	GPQA Diamond	mean_score	0.43
02	MATH Level 5	mean_score	0.26