Falcon3-Mamba-7B
Falcon3-Mamba-7B is released 2024-12-17 in the Falcon Mamba family with open-weight; evaluate it while provider pricing coverage matures.
- Family
- Falcon Mamba
- Released
- 2024-12-17
- Context
- 32k
- Parameters
- 7B
- Architecture
- Decoder Only
- Specialization
- general
- Openness
- Open weights
- License
- TII Falcon License 2.0Commercial use: permitted
- Weights
- Available
- Code
- Unknown
- Training
- Pretrained
No tracked provider token pricing is available yet.
About
Falcon3-Mamba-7B is TII's enhanced version of Falcon Mamba 7B, trained on an additional 1.5 trillion tokens of high-quality data with improved reasoning and mathematical capabilities. Released December 17, 2024 as part of the Falcon 3 model family. Pure Mamba state-space architecture with no attention mechanism. 65K vocabulary. Matches or surpasses leading transformer-based LLMs at the 7B scale on multiple benchmarks. Backward compatible with Falcon Mamba 7B — same architecture, no integration changes needed. Instruct variant available at tiiuae/Falcon3-Mamba-7B-Instruct.
Provider price ladder
No tracked provider token pricing is available for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
No tracked provider token pricing is available yet.