RecurrentGemma Models by Google DeepMind

Google DeepMindGemmaOpen weights
Google DeepMind releases · 53 in the last 12 monthsChangelog →
2 models2024Up to 4K ctx

Last refreshed 2026-10-09. Next refresh: weekly.

Details

ResearcherGoogle DeepMind
LicenseGemma
Commercial useRestricted
Models2
Released2024
Max context4K

About

RecurrentGemma is a family of open-weight language models developed by Google DeepMind, known for their cutting-edge Griffin architecture. This hybrid design blends linear recurrences with local attention mechanisms, allowing the models to excel in a range of language tasks with reduced memory overhead and efficient inference, especially on lengthy sequences. Unlike traditional transformer models that require memory scaling linearly with sequence length, RecurrentGemma maintains a fixed-sized state, resulting in faster processing speeds. Both pre-trained and instruction-tuned variants are available, the latter being tailored for tasks like dialogue and instruction following. Accessible through platforms like Hugging Face and Kaggle, RecurrentGemma-2B achieves performance akin to Gemma-2B despite being trained on fewer tokens, demonstrating its efficiency and versatility.

Decision facts

Best fit
chatbot and role-playing use cases
Capability starting point
RecurrentGemma 9B with 4K context
Lowest tracked input
Not tracked
Closest related family
DiffusionGemma

Current Variants

Use-when guidance is based on each model's tracked capabilities, context window, release date, and replacement status.

1 in view1 retired

Use when the workload needs 4K context and 9B parameters.

2024-064K context9B parameters

Release Timeline

2 release groups
2024-06
1 current
RecurrentGemma 9B
4K context9B parameters
Current
2024-04
1 retired
RecurrentGemma 2B
4K context2B parameters
Archived

Specifications(2 models)

RecurrentGemma model specifications comparison
ModelReleasedContextParameters
RecurrentGemma 9B2024-064K9B

Available From(1 provider)

Models(2)