MPT 30B on Databricks Foundation Model Serving

MPT · Databricks Mosaic

ServerlessOpen Source

Last refreshed 2026-05-19. Next refresh: weekly.

Why use MPT 30B on Databricks Foundation Model Serving?

Databricks Foundation Model Serving offers MPT 30B with pay-as-you-go pricing at $1.00/1M input tokens. Databricks offers a comprehensive Data Intelligence Platform that unifies data, analytics, and AI capabilities.

Input / 1M
$1.00
Output / 1M
$1.00
Cache
Not sourced
Batch
Not sourced

Setup recipe

Docs fallback
Install
Use the provider REST API or SDK
Auth
Create a provider API key
Call
model: mpt-30b
Model ID
mpt-30b

Request example

Curated snippets for this provider are not sourced yet. Use Databricks Foundation Model Serving documentation with model ID mpt-30b.

Gotchas

No curated gotchas have been sourced for this exact provider/model route yet.

Pricing

TypePrice (per 1M)
Input tokens$1.00
Output tokens$1.00

Capabilities

No model capability flags are currently sourced.

About MPT 30B

MPT-30B, developed by MosaicML, is a powerful large language model (LLM) utilizing a decoder-only transformer architecture that excels in predicting the next word in a sequence. This model is particularly adept at handling various NLP tasks, such as text generation, question answering, summarization, and code generation, due to its training on a diverse dataset of 1 trillion tokens of English text and code. Notable architectural innovations like FlashAttention, ALiBi, and no biases contribute to its enhanced efficiency, allowing for operation on a single high-end GPU.

Get Started

Model Specs

Released2023-03-16
Parameters30B
Context8k
ArchitectureDecoder Only

Related Models on Databricks Foundation Model Serving