Claude 2.1

Published

Nov 21, 2023

Claude 2.1 is an AI model developed by Anthropic (United States), first published in November 2023. It works in the language domain, on tasks such as language modeling, chat, language modeling/generation and question answering.

Epoch AI has no training-compute estimate for this model.

Access: API access. Its weights are not openly released. It is built on top of Claude 2.

Full record

Organization: Anthropic
Country of organization: United States
Domain: Language
Task: Language modeling, Chat, Language modeling/generation, Question answering
Model accessibility: API access
Open weights: No
Base model: Claude 2

Benchmark results

01	Epoch Capabilities Index	ECI Score	118.3
02	ForecastBench	Overall score	54.2
03	MMLU	EM	0.73
04	GPQA Diamond	mean_score	0.33
05	WeirdML	Accuracy	0.07
06	OTIS Mock AIME 2024-2025	mean_score	0.02