LLM Reference

RWKV-6 Finch 14B

Released
2024-09-03
Last refreshed
2026-06-29
Status
Researched 45d ago
Open sourceCommercial use: permittedLong context

RWKV-6 Finch 14B is a released long context model with open-source and Infinite context; evaluate it while provider pricing coverage matures.

Use it for

  • Teams evaluating long context
  • Workloads that can use a Infinite context window

Do not use it for

  • Cost-sensitive launches that need sourced token pricing
  • Vision or document-understanding workloads
  • Strict JSON or tool-calling flows
Specifications
Released
2024-09-03
Context
Infinite
Parameters
14B
Architecture
Decoder Only
Specialization
general
Openness
Open source
License
Apache 2.0OSI-approvedCommercial use: permitted
Weights
Available
Code
Unknown
Training
Pretrained
Created by

Linear complexity language models combining the efficiency of RNNs with the parallelism of Transformers

Global / Linux Foundation AI & Data
Website
Pricing

No tracked provider token pricing is available yet.

About

RWKV-6 Finch 14B is the largest model in the RWKV-6 Finch series, created by stacking two 7B Finch models. Released September 3, 2024. Achieves strong performance on MMLU (56.05%), ARC, HellaSwag (57.69%), and Winogrande (74.43%). The RWKV-6 architecture uses matrix-valued states and dynamic data-driven recurrence, improving comprehension and in-context reasoning compared to RWKV-5 (Eagle). Constant-memory O(1) inference with no KV cache. Apache 2.0 licensed.

RWKV-6 Finch 14B is an open-source model in the RWKV-6 Finch family. The structured metadata tracks a Infinite context window. No headline benchmark score is tracked for RWKV-6 Finch 14B yet.

Top use-case fit

Long context

Included by capability and metadata signals in the decision map.

Provider price ladder

No tracked provider token pricing is available for this model yet.

Capabilities

No model capability flags are currently sourced.

Benchmark peer barsfor Long context

No task-mapped benchmark peers are available for this model yet.

Migration checks

No linked migration route is available for this model yet.

Frequently asked questions

What is the context window of RWKV-6 Finch 14B?

RWKV-6 Finch 14B has a context window of Infinite tokens.

When was RWKV-6 Finch 14B released?

RWKV-6 Finch 14B was released on 2024-09-03.