RWKV-7 Goose Models by RWKV Project

RWKV ProjectApache 2.0Open source

4 models2025

Last refreshed 2026-06-29. Next refresh: weekly.

Details

ResearcherRWKV Project

LicenseApache 2.0OSI-approved

Commercial useCommercial use: permitted

Models4

Released2025

Links

Website HuggingFace

About

RWKV-7 (codenamed Goose) is the seventh-generation RWKV architecture, introduced in the paper 'RWKV-7 Goose with Expressive Dynamic State Evolution' (March 2025, arXiv 2503.14456). Goose introduces the Generalized Delta Rule and expressive dynamic state evolution, comprehensively outperforming RWKV-6 and competitive with Transformer models of equivalent scale across reasoning, coding, and mathematical benchmarks. World3 training corpus spans 3.1 trillion tokens and 100+ languages. Available in four sizes: 0.1B, 0.4B, 1.5B, and 2.9B. All models are Apache 2.0 licensed and available via HuggingFace Transformers. RWKV-8 (Heron) is in early experimental development as of May 2025.

Decision facts

Best fit: codingmath-heavy prompts
Capability starting point: RWKV-7 Goose 0.1B
Lowest tracked input: Not tracked
Closest related family: RWKV-6 Finch

Current Variants

Use-when guidance is based on each model's tracked capabilities, context window, release date, and replacement status.

4 in view

RWKV-7 Goose 0.1BCurrent

Use when the workload needs Infinity context and 190M parameters.

2025-03Infinity context190M parameters

RWKV-7 Goose 0.4BCurrent

Use when the workload needs Infinity context and 450M parameters.

2025-03Infinity context450M parameters

RWKV-7 Goose 1.5BCurrent

Use when the workload needs Infinity context and 1.5B parameters.

2025-03Infinity context1.5B parameters

RWKV-7 Goose 2.9BCurrent

Use when the workload needs Infinity context and 2.9B parameters.

2025-03Infinity context2.9B parameters

Current RWKV-7 Goose variants with use-when guidance and lifecycle status
Model	Use when	Released	Signals	Status
RWKV-7 Goose 0.1B	Use when the workload needs Infinity context and 190M parameters.	2025-03	Infinity context190M parameters	Current
RWKV-7 Goose 0.4B	Use when the workload needs Infinity context and 450M parameters.	2025-03	Infinity context450M parameters	Current
RWKV-7 Goose 1.5B	Use when the workload needs Infinity context and 1.5B parameters.	2025-03	Infinity context1.5B parameters	Current
RWKV-7 Goose 2.9B	Use when the workload needs Infinity context and 2.9B parameters.	2025-03	Infinity context2.9B parameters	Current