MPT 30B
- Family
- MPT
- Released
- 2023-03-16
- Context
- 8K
- Parameters
- 30B
- Architecture
- Decoder Only
- Specialization
- general
- Openness
- Open source
- License
- Apache 2.0OSI-approvedPermitted
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
Advancing AI research and model development.
No tracked provider pricing is available yet.
About
MPT-30B, developed by MosaicML, is a powerful large language model (LLM) utilizing a decoder-only transformer architecture that excels in predicting the next word in a sequence. This model is particularly adept at handling various NLP tasks, such as text generation, question answering, summarization, and code generation, due to its training on a diverse dataset of 1 trillion tokens of English text and code. Notable architectural innovations like FlashAttention, ALiBi, and no biases contribute to its enhanced efficiency, allowing for operation on a single high-end GPU.
Providers
No active provider routes are tracked for this model yet.
Deprecated provider routes(1)
| Provider | Status | Catalog ID |
|---|---|---|
| Databricks Foundation Model Serving | Deprecated | — |
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
Advancing AI research and model development.
No tracked provider pricing is available yet.