LLM ReferenceLLM Reference
Databricks Foundation Model Serving

DBRX Instruct on Databricks Foundation Model Serving

DBRX · Databricks Mosaic

ServerlessProvisioned

Last refreshed 2026-04-19. Next refresh: weekly.

Why use DBRX Instruct on Databricks Foundation Model Serving?

Databricks Foundation Model Serving offers DBRX Instruct with pay-as-you-go pricing at $0.75/1M input tokens. Databricks offers a comprehensive Data Intelligence Platform that unifies data, analytics, and AI capabilities.

Compare DBRX Instruct across 6 providers to find the best fit for your use case
Input / 1M
$0.75
Output / 1M
$2.25
Cache
Not sourced
Batch
Not sourced

Setup recipe

Docs fallback
Install
Use the provider REST API or SDK
Auth
Create a provider API key
Call
model: dbrx-instruct
Model ID
dbrx-instruct

Request example

Curated snippets for this provider are not sourced yet. Use Databricks Foundation Model Serving documentation with model ID dbrx-instruct.

Gotchas

No curated gotchas have been sourced for this exact provider/model route yet.

Compare DBRX Instruct Across Providers

ProviderInput (per 1M)Output (per 1M)
Microsoft Foundry$2.70$2.70
Databricks Foundation Model Serving$0.75$2.25
Together AI$1.20$1.20
NVIDIA NIM
DeepInfra$0.60$1.20
View all 6 providers →

Pricing

TypePrice (per 1M)
Input tokens$0.75
Output tokens$2.25

Capabilities

Structured Outputs

About DBRX Instruct

DBRX Instruct, developed by Databricks, is a cutting-edge large language model designed for various natural language processing tasks. It excels in text summarization, question answering, information extraction, and code generation, utilizing a fine-grained mixture-of-experts architecture with 132 billion parameters. With advanced features like rotary position encodings, gated linear units, and grouped query attention, it performs exceptionally across multiple benchmarks, even outperforming some closed-source models. Trained on a vast 12 trillion token dataset, it supports contexts up to 32,000 tokens. Although primarily effective in English, its multilingual strength isn't fully explored. Users should be cautious as it may generate inaccurate or biased outputs.

FAQ

What does DBRX Instruct cost on Databricks Foundation Model Serving?

On Databricks Foundation Model Serving, DBRX Instruct costs $0.75 per 1M input tokens and $2.25 per 1M output tokens.

What is the context window for DBRX Instruct on Databricks Foundation Model Serving?

DBRX Instruct supports a 32,000 token context window on Databricks Foundation Model Serving.

How does Databricks Foundation Model Serving compare to other DBRX Instruct providers?

DBRX Instruct is available from 6 providers. The cheapest input pricing is $0.60/1M tokens from DeepInfra.

Who created DBRX Instruct?

DBRX Instruct was created by Databricks Mosaic as part of the DBRX model family.

Is DBRX Instruct open source?

DBRX Instruct's open source status is unknown in the seed data.

Get Started

Model Specs

Released2024-03-27
Parameters132B
Context32K
ArchitectureMixture of Experts

GPU-Hour Providers(1)

Related Models on Databricks Foundation Model Serving