Mamba 2 780M
Mamba 2 780M is released 2023-12-08 in the Mamba 2 family with open-source; evaluate it while provider pricing coverage matures.
- Family
- Mamba 2
- Released
- 2023-12-08
- Context
- 2K
- Parameters
- 780M
- Architecture
- Decoder Only
- Knowledge cutoff
- 2020
- Specialization
- general
- Openness
- Open source
- License
- Apache 2.0OSI-approvedPermitted
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
No tracked provider pricing is available yet.
About
Mamba-2 780M is a cutting-edge large language model that enhances the capabilities of its predecessor with an innovative Structured State Space Model (SSM) architecture. This design enables efficient handling of long sequences while maintaining competitive performance against traditional transformers. It utilizes the Structured State Space Duality (SSD) technique to blend benefits of SSMs and attention mechanisms, allowing linear scaling and optimal memory use during inference. Mamba-2 780M is adept at tasks requiring processing of extensive data and excels in language and multimodal applications.
Providers
No active provider routes are tracked for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
No tracked provider pricing is available yet.