Falcon2 11B
Falcon2 11B is released 2024-05-24 in the Falcon2 family with open-weight; evaluate it while provider pricing coverage matures.
- Family
- Falcon2
- Released
- 2024-05-24
- Context
- 8K
- Parameters
- 11B
- Architecture
- Decoder Only
- Specialization
- general
- Openness
- Open weights
- License
- TII Falcon License 2.0Commercial use: permitted
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
No tracked provider pricing is available yet.
About
Falcon2-11B is an 11-billion parameter causal decoder-only large language model developed by the Technology Innovation Institute. It is constructed using the Transformer architecture that includes grouped query attention with FlashAttention-2 for enhanced speed and efficiency. Trained on more than 5 trillion tokens from the RefinedWeb dataset and supplemented by curated corpora, it supports eleven languages such as English, German, and Spanish. Falcon2-11B exhibits strong performance in multilingual and code generation tasks, often outperforming similar models like Llama3-8B and Mistral-7B, and matching Gemma-7B in performance.
Providers
No active provider routes are tracked for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
No tracked provider pricing is available yet.