RWKV-6 Finch 14B
RWKV-6 Finch 14B is a released long context model with open-source and Infinite context; evaluate it while provider pricing coverage matures.
- Family
- RWKV-6 Finch
- Released
- 2024-09-03
- Context
- Infinite
- Parameters
- 14B
- Architecture
- Decoder Only
- Specialization
- general
- Openness
- Open source
- License
- Apache 2.0OSI-approvedCommercial use: permitted
- Weights
- Available
- Code
- Unknown
- Training
- Pretrained
Linear complexity language models combining the efficiency of RNNs with the parallelism of Transformers
No tracked provider token pricing is available yet.
About
RWKV-6 Finch 14B is the largest model in the RWKV-6 Finch series, created by stacking two 7B Finch models. Released September 3, 2024. Achieves strong performance on MMLU (56.05%), ARC, HellaSwag (57.69%), and Winogrande (74.43%). The RWKV-6 architecture uses matrix-valued states and dynamic data-driven recurrence, improving comprehension and in-context reasoning compared to RWKV-5 (Eagle). Constant-memory O(1) inference with no KV cache. Apache 2.0 licensed.
Provider price ladder
No tracked provider token pricing is available for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Long context
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
Rankings & picks(2)
Linear complexity language models combining the efficiency of RNNs with the parallelism of Transformers
No tracked provider token pricing is available yet.