Falcon
About
The Falcon family of large language models (LLMs), developed by the Technology Innovation Institute (TII) in Abu Dhabi, offers a diverse range of models that are open-source and freely available for research and commercial applications. Notably, this includes the Falcon-40B, which excelled on the Hugging Face Open LLM Leaderboard, and the even more advanced Falcon-180B, which matches the performance of many proprietary models. These models benefit from training on extensive datasets like the RefinedWeb dataset, known for its high-quality, filtered, and deduplicated web content. Additionally, the Falcon family includes instruction-tuned versions, such as Falcon-7B-Instruct and Falcon-40B-Instruct, optimized for conversational interactions. Recently, the Falcon Mamba 7B was introduced, offering improved memory efficiency and enhanced long-text generation through its novel state-space language model (SSLM) architecture. This family of models underscores a strong commitment to open-source AI, making advanced language capabilities accessible to a broad audience of researchers and users 1481011.
Specifications(4 models)
| Model | Released | Context | Parameters | Structured Outputs |
|---|---|---|---|---|
| Falcon 3 7B Instruct | 2024-12 | 128K | 7B | No |
| Falcon 180B | 2023-11 | — | 180B | No |
| Falcon 40B | 2023-11 | — | 40B | Yes |
| Falcon 7B | 2023-11 | — | 7B | Yes |
Available From(7 providers)
Pricing
| Model | Provider | Input / 1M | Output / 1M | Type |
|---|---|---|---|---|
| Falcon 7B | Microsoft Foundry | $0.52 | $0.67 | Provisioned |
| Falcon 40B | Replicate API | $0.65 | $2.75 | Serverless |
| Falcon 40B | Microsoft Foundry | $1.54 | $1.77 | Provisioned |
Frequently Asked Questions
- What is Falcon?
- The Falcon family of large language models (LLMs), developed by the Technology Innovation Institute (TII) in Abu Dhabi, offers a diverse range of models that are open-source and freely available for research and commercial applications. Notably, this includes the Falcon-40B, which excelled on the Hugging Face Open LLM Leaderboard, and the even more advanced Falcon-180B, which matches the performance of many proprietary models. These models benefit from training on extensive datasets like the RefinedWeb dataset, known for its high-quality, filtered, and deduplicated web content. Additionally, the Falcon family includes instruction-tuned versions, such as Falcon-7B-Instruct and Falcon-40B-Instruct, optimized for conversational interactions. Recently, the Falcon Mamba 7B was introduced, offering improved memory efficiency and enhanced long-text generation through its novel state-space language model (SSLM) architecture. This family of models underscores a strong commitment to open-source AI, making advanced language capabilities accessible to a broad audience of researchers and users 1481011.
- How many models are in the Falcon family?
- The Falcon family contains 4 models.
- What is the latest Falcon model?
- The latest model is Falcon 3 7B Instruct, released in 2024-12.
- How much does Falcon cost?
- Falcon models range from $0.52/1M to $1.54/1M input tokens depending on the model and provider.
- Is Falcon open source?
- 1 of 4 Falcon models are open source.
