Live
AI models

ToolFormer

Parameters
6.7B
Published
Feb 9, 2023

ToolFormer is an AI model developed by Meta AI (United States), first published in February 2023. It works in the language domain.

Epoch AI has no training-compute estimate for this model. The model has 6,700,000,000 parameters. Training ran on 8 NVIDIA A100 SXM4 40 GB.

It is built on top of GPT-J-6B. The reference paper has 3,842 citations. Epoch AI rates the confidence of this record as confident.

Full record
Organization
Meta AI
Country of organization
United States
Domain
Language
Parameters
6,700,000,000
Training hardware
NVIDIA A100 SXM4 40 GB
Chips used
8
Training power draw
6.4 kW
Base model
GPT-J-6B
Citations
3,842
Epoch confidence
Confident
More from Meta AI
SourceEpoch AI, 'AI Models'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/data/ai-models. Licensed under CC BY 4.0.
← All ai models