LLM Reference

RWKV-7 Goose Models by RWKV Project

RWKV ProjectApache 2.0
4 models2025

About

RWKV-7 (codenamed Goose) is the seventh-generation RWKV architecture, introduced in the paper 'RWKV-7 Goose with Expressive Dynamic State Evolution' (March 2025, arXiv 2503.14456). Goose introduces the Generalized Delta Rule and expressive dynamic state evolution, comprehensively outperforming RWKV-6 and competitive with Transformer models of equivalent scale across reasoning, coding, and mathematical benchmarks. World3 training corpus spans 3.1 trillion tokens and 100+ languages. Available in four sizes: 0.1B, 0.4B, 1.5B, and 2.9B. All models are Apache 2.0 licensed and available via HuggingFace Transformers. RWKV-8 (Heron) is in early experimental development as of May 2025.

Current Variants

Use-when guidance is derived from seed capabilities, context, release, and replacement fields.

4 in view

Use when the workload needs 2.9B parameters.

2025-032.9B parameters

Use when the workload needs 1.5B parameters.

2025-031.5B parameters

Use when the workload needs 450M parameters.

2025-03450M parameters

Use when the workload needs 190M parameters.

2025-03190M parameters

Release Timeline

1 release group
2025-03
4 current
RWKV-7 Goose 0.1B
190M parameters
Current
RWKV-7 Goose 0.4B
450M parameters
Current
RWKV-7 Goose 1.5B
1.5B parameters
Current
RWKV-7 Goose 2.9B
2.9B parameters
Current

Specifications(4 models)

RWKV-7 Goose model specifications comparison
ModelReleasedContextParameters
RWKV-7 Goose 2.9B2025-03Infinite2.9B
RWKV-7 Goose 1.5B2025-03Infinite1.5B
RWKV-7 Goose 0.4B2025-03Infinite450M
RWKV-7 Goose 0.1B2025-03Infinite190M

Frequently Asked Questions

What is RWKV-7 Goose used for?
RWKV-7 Goose is used for coding and math-heavy prompts. The family description and listed model capabilities point to those workloads as the best fit.
How does RWKV-7 Goose compare to RWKV-6 Finch?
RWKV-7 Goose by RWKV Project is strongest where you need coding, while RWKV-6 Finch by RWKV Project is the closest related family to check for coding. RWKV-7 Goose has 4 listed variants, so compare the specs and pricing tables before choosing a production model.
Which RWKV-7 Goose model should I use?
If price is the main constraint, use the pricing table first because RWKV-7 Goose does not have complete provider pricing in the local data. For the most capable/latest local choice, evaluate RWKV-7 Goose 2.9B.

Models(4)