RWKV-6 Finch Models by RWKV Project

RWKV ProjectApache 2.0Open source
4 models2024

Last refreshed 2026-06-29. Next refresh: weekly.

Details

ResearcherRWKV Project
LicenseApache 2.0OSI-approved
Commercial usePermitted
Models4
Released2024

About

RWKV-6 (codenamed Finch) is the sixth-generation architecture in the RWKV series, introduced in the paper 'Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence' (April 2024). Finch upgrades the state representation to multi-headed matrix-valued states and introduces dynamic data-driven recurrence, achieving significantly better benchmark performance than RWKV-5 (Eagle) without sacrificing the architecture's defining O(n) training complexity and O(1) constant-memory inference. Models are available in 1.6B, 3B, 7B, and 14B parameter sizes. The 14B model (released September 2024) was created by stacking two 7B models and is the largest released RWKV-6 model. All World variants are multilingual (100+ languages). Apache 2.0 licensed.

Decision facts

Best fit
coding
Capability starting point
RWKV-6 Finch 14B
Lowest tracked input
Not tracked
Closest related family
RWKV-7 Goose

Current Variants

Use-when guidance is based on each model's tracked capabilities, context window, release date, and replacement status.

4 in view

Use when the workload needs — context and 14B parameters.

2024-09— context14B parameters

Use when the workload needs — context and 1.6B parameters.

2024-04— context1.6B parameters

Use when the workload needs — context and 3B parameters.

2024-04— context3B parameters

Use when the workload needs — context and 7B parameters.

2024-04— context7B parameters

Release Timeline

2 release groups
2024-09
1 current
RWKV-6 Finch 14B
— context14B parameters
Current
2024-04
3 current
RWKV-6 Finch 1.6B
— context1.6B parameters
Current
RWKV-6 Finch 3B
— context3B parameters
Current
RWKV-6 Finch 7B
— context7B parameters
Current

Specifications(4 models)

RWKV-6 Finch model specifications comparison
ModelReleasedContextParameters
RWKV-6 Finch 14B2024-09Infinite14B
RWKV-6 Finch 1.6B2024-04Infinite1.6B
RWKV-6 Finch 3B2024-04Infinite3B
RWKV-6 Finch 7B2024-04Infinite7B