RWKV-6 Finch 14B
RWKV-6 Finch 14B is a released long context model with open-source and Infinite context; evaluate it while provider pricing coverage matures.
- Family
- RWKV-6 Finch
- Released
- 2024-09-03
- Context
- Infinite
- Parameters
- 14B
- Architecture
- Decoder Only
- Specialization
- general
- Openness
- Open source
- License
- Apache 2.0OSI-approvedPermitted
- Weights
- Available
- Code
- Unknown
- Training
- Pretrained
Linear complexity language models combining the efficiency of RNNs with the parallelism of Transformers
No tracked provider pricing is available yet.
Linear complexity language models combining the efficiency of RNNs with the parallelism of Transformers
No tracked provider pricing is available yet.
About
RWKV-6 Finch 14B is the largest model in the RWKV-6 Finch series, created by stacking two 7B Finch models. Released September 3, 2024. Achieves strong performance on MMLU (56.05%), ARC, HellaSwag (57.69%), and Winogrande (74.43%). The RWKV-6 architecture uses matrix-valued states and dynamic data-driven recurrence, improving comprehension and in-context reasoning compared to RWKV-5 (Eagle). Constant-memory O(1) inference with no KV cache. Apache 2.0 licensed.
Providers
No active provider routes are tracked for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Long context
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.