Using MPT 30B on Databricks Foundation Model Serving
Implementation guide · MPT · Databricks Mosaic
Databricks Foundation Model Serving exposes MPT 30B through model ID mpt-30b. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.
Last refreshed 2026-05-19. Next refresh: weekly.
Quick Start
- 1
- 2Use the Databricks Foundation Model Serving SDK or REST API to call
mpt-30b— see the documentation for request format. - 3
Code Examples
Pricing on Databricks Foundation Model Serving
| Type | Price (per 1M) |
|---|---|
| Input tokens | $1.00 |
| Output tokens | $1.00 |
Capabilities
No model capability flags are currently sourced.
About MPT 30B
MPT-30B, developed by MosaicML, is a powerful large language model (LLM) utilizing a decoder-only transformer architecture that excels in predicting the next word in a sequence. This model is particularly adept at handling various NLP tasks, such as text generation, question answering, summarization, and code generation, due to its training on a diverse dataset of 1 trillion tokens of English text and code. Notable architectural innovations like FlashAttention, ALiBi, and no biases contribute to its enhanced efficiency, allowing for operation on a single high-end GPU.