LLM Reference

Falcon2 Models by Technology Innovation Institute (TII)

Technology Innovation Institute (TII)TII Falcon License 2.0Open Source
1 model2024Up to 8k ctx

About

The Falcon LLM family, developed by the Technology Innovation Institute (TII), includes a range of large language models (LLMs) with varying parameter sizes, offering diverse capabilities in processing and understanding language 139. The Falcon2 series marks a significant leap forward, prioritizing compact, efficient models with improved performance metrics 21112. Its premier model, Falcon2-11B, features 11 billion parameters and utilizes over 5,000 billion tokens of RefinedWeb data, supplemented by specially curated datasets 257. This model outperforms Meta's Llama 3 8B and rivals Google's Gemma 7B in terms of capability 12. Notably, Falcon2 also includes a Falcon2-11B VLM variant, integrating image comprehension abilities as the only AI model with vision-to-language support 2412. Both models are open-source under a permissive license, designed for efficient operation on a single GPU, with future updates planned to incorporate "Mixture of Experts" to enhance their prowess 12.

Current Variants

Use-when guidance is derived from seed capabilities, context, release, and replacement fields.

1 in view

Use when the workload needs 8k context and 11B parameters.

2024-058k context11B parameters

Release Timeline

1 release group
2024-05
1 current
Falcon2 11B
8k context11B parameters
Current

Specifications(1 models)

Falcon2 model specifications comparison
ModelReleasedContextParameters
Falcon2 11B2024-058k11B

Frequently Asked Questions

What is Falcon2 used for?
Falcon2 is used for coding. The family description and listed model capabilities point to those workloads as the best fit.
How does Falcon2 compare to MOSS-Audio?
Falcon2 by Technology Innovation Institute (TII) is strongest where you need coding, while MOSS-Audio by MOSI Intelligence is the closest related family to check for multimodal. Falcon2 has 1 listed variant and reaches up to 8k context, so compare the specs and pricing tables before choosing a production model.
Which Falcon2 model should I use?
If price is the main constraint, use the pricing table first because Falcon2 does not have complete provider pricing in the local data. For the most capable/latest local choice, evaluate Falcon2 11B with 8k context.

Models(1)