RWKV-6 Finch 14B

Released
2024-09-03
Last refreshed
2026-06-29
Status
Researched 179d ago
Open sourceCommercial use: permittedLong context

RWKV-6 Finch 14B is a released long context model with open-source and Infinite context; evaluate it while provider pricing coverage matures.

Specifications
Released
2024-09-03
Context
Infinite
Parameters
14B
Architecture
Decoder Only
Specialization
general
Openness
Open source
License
Apache 2.0OSI-approvedPermitted
Weights
Available
Code
Unknown
Training
Pretrained
Created by

Linear complexity language models combining the efficiency of RNNs with the parallelism of Transformers

Global / Linux Foundation AI & Data
Website
Pricing

No tracked provider pricing is available yet.

About

RWKV-6 Finch 14B is the largest model in the RWKV-6 Finch series, created by stacking two 7B Finch models. Released September 3, 2024. Achieves strong performance on MMLU (56.05%), ARC, HellaSwag (57.69%), and Winogrande (74.43%). The RWKV-6 architecture uses matrix-valued states and dynamic data-driven recurrence, improving comprehension and in-context reasoning compared to RWKV-5 (Eagle). Constant-memory O(1) inference with no KV cache. Apache 2.0 licensed.

Providers

No active provider routes are tracked for this model yet.

Capabilities

No model capability flags are currently sourced.

Benchmark peer barsfor Long context

No task-mapped benchmark peers are available for this model yet.

Migration checks

No linked migration route is available for this model yet.