Falcon3-Mamba-7B
Falcon3-Mamba-7B is released 2024-12-17 in the Falcon Mamba family with open-weight; evaluate it while provider pricing coverage matures.
Use it for
- Teams evaluating general LLM work
- Workloads that can use a 32k context window
Do not use it for
- Cost-sensitive launches that need sourced token pricing
- Vision or document-understanding workloads
- Strict JSON or tool-calling flows
- Family
- Falcon Mamba
- Released
- 2024-12-17
- Context
- 32k
- Parameters
- 7B
- Architecture
- Decoder Only
- Specialization
- general
- Openness
- Open weights
- License
- TII Falcon License 2.0Commercial use: permitted
- Weights
- Available
- Code
- Unknown
- Training
- Pretrained
No tracked provider token pricing is available yet.
About
Falcon3-Mamba-7B is TII's enhanced version of Falcon Mamba 7B, trained on an additional 1.5 trillion tokens of high-quality data with improved reasoning and mathematical capabilities. Released December 17, 2024 as part of the Falcon 3 model family. Pure Mamba state-space architecture with no attention mechanism. 65K vocabulary. Matches or surpasses leading transformer-based LLMs at the 7B scale on multiple benchmarks. Backward compatible with Falcon Mamba 7B — same architecture, no integration changes needed. Instruct variant available at tiiuae/Falcon3-Mamba-7B-Instruct.
Falcon3-Mamba-7B is an open-weight model in the Falcon Mamba family. The structured metadata tracks a 32k-token context window. No headline benchmark score is tracked for Falcon3-Mamba-7B yet.
Top use-case fit
No primary decision-task fit is mapped for this model yet.
Provider price ladder
No tracked provider token pricing is available for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
Frequently asked questions
What is the context window of Falcon3-Mamba-7B?
Falcon3-Mamba-7B has a context window of 32k tokens.
When was Falcon3-Mamba-7B released?
Falcon3-Mamba-7B was released on 2024-12-17.
No tracked provider token pricing is available yet.