RWKV-7 Goose Models by RWKV Project
Last refreshed 2026-06-29. Next refresh: weekly.
Details
About
RWKV-7 (codenamed Goose) is the seventh-generation RWKV architecture, introduced in the paper 'RWKV-7 Goose with Expressive Dynamic State Evolution' (March 2025, arXiv 2503.14456). Goose introduces the Generalized Delta Rule and expressive dynamic state evolution, comprehensively outperforming RWKV-6 and competitive with Transformer models of equivalent scale across reasoning, coding, and mathematical benchmarks. World3 training corpus spans 3.1 trillion tokens and 100+ languages. Available in four sizes: 0.1B, 0.4B, 1.5B, and 2.9B. All models are Apache 2.0 licensed and available via HuggingFace Transformers. RWKV-8 (Heron) is in early experimental development as of May 2025.
Decision facts
- Best fit
- codingmath-heavy prompts
- Capability starting point
- RWKV-7 Goose 0.1B
- Lowest tracked input
- Not tracked
- Closest related family
- RWKV-6 Finch
Current Variants
Use-when guidance is based on each model's tracked capabilities, context window, release date, and replacement status.
Use when the workload needs — context and 190M parameters.
Use when the workload needs — context and 450M parameters.
Use when the workload needs — context and 1.5B parameters.
Use when the workload needs — context and 2.9B parameters.
| Model | Use when | Released | Signals | Status |
|---|---|---|---|---|
| RWKV-7 Goose 0.1B | Use when the workload needs — context and 190M parameters. | 2025-03 | — context190M parameters | Current |
| RWKV-7 Goose 0.4B | Use when the workload needs — context and 450M parameters. | 2025-03 | — context450M parameters | Current |
| RWKV-7 Goose 1.5B | Use when the workload needs — context and 1.5B parameters. | 2025-03 | — context1.5B parameters | Current |
| RWKV-7 Goose 2.9B | Use when the workload needs — context and 2.9B parameters. | 2025-03 | — context2.9B parameters | Current |
Release Timeline
1 release groupSpecifications(4 models)
| Model | Released | Context | Parameters |
|---|---|---|---|
| RWKV-7 Goose 0.1B | 2025-03 | Infinite | 190M |
| RWKV-7 Goose 0.4B | 2025-03 | Infinite | 450M |
| RWKV-7 Goose 1.5B | 2025-03 | Infinite | 1.5B |
| RWKV-7 Goose 2.9B | 2025-03 | Infinite | 2.9B |