Gemma 3 27B

Training compute

2.3×10²⁴ FLOP

Parameters

27B

Published

Mar 12, 2025

Gemma 3 27B is an AI model developed by Google DeepMind (United States), first published in March 2025. It works in the language, vision and multimodal domain, on tasks such as language modeling/generation, question answering, translation and 4 more.

Training it took an estimated 2.3×10²⁴ FLOP of compute (estimation method: operation counting). The model has 27,000,000,000 parameters. It was trained on roughly 14T datapoints. Training ran on 6,144 Google TPU v5p.

Access: Open weights (restricted use). Its weights are openly available. It is built on top of SigLIP 400M. Epoch AI rates the confidence of this record as confident.

Full record

Organization: Google DeepMind
Country of organization: United States
Domain: Language, Vision, Multimodal
Task: Language modeling/generation, Question answering, Translation, Chat, Quantitative reasoning, Visual question answering, Code generation
Training compute: 2.3×10²⁴ FLOP
Compute estimation method: Operation counting
Parameters: 27,000,000,000
Dataset size: 14T
Training hardware: Google TPU v5p
Chips used: 6,144
Training power draw: 6.5 MW
Model accessibility: Open weights (restricted use)
Open weights: Yes
Base model: SigLIP 400M
Epoch confidence: Confident

Benchmark results

01

Epoch Capabilities Index

ECI Score

131.1