Last refreshed 2026-05-01. Next refresh: weekly.
Why use DBRX Instruct on NVIDIA NIM?
NVIDIA NIM offers DBRX Instruct with competitive pricing. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.
Compare DBRX Instruct across 6 providers to find the best fit for your use caseSetup recipe
Docs fallbackUse the provider REST API or SDKCreate a provider API keymodel: dbrx-instructdbrx-instructRequest example
dbrx-instruct.Gotchas
No curated gotchas have been sourced for this exact provider/model route yet.
Compare DBRX Instruct Across Providers
| Provider | Input (per 1M) | Output (per 1M) |
|---|---|---|
| Microsoft Foundry | $2.70 | $2.70 |
| Databricks Foundation Model Serving | $0.75 | $2.25 |
| Together AI | $1.20 | $1.20 |
| NVIDIA NIM | — | — |
| DeepInfra | $0.60 | $1.20 |
Pricing
| Type | Rate |
|---|---|
| GPU Hour Rate | $1.00/GPU·hr |
| GPU Config | 1xH100 |
Capabilities
About DBRX Instruct
DBRX Instruct, developed by Databricks, is a cutting-edge large language model designed for various natural language processing tasks. It excels in text summarization, question answering, information extraction, and code generation, utilizing a fine-grained mixture-of-experts architecture with 132 billion parameters. With advanced features like rotary position encodings, gated linear units, and grouped query attention, it performs exceptionally across multiple benchmarks, even outperforming some closed-source models. Trained on a vast 12 trillion token dataset, it supports contexts up to 32,000 tokens. Although primarily effective in English, its multilingual strength isn't fully explored. Users should be cautious as it may generate inaccurate or biased outputs.
FAQ
What is the context window for DBRX Instruct on NVIDIA NIM?
DBRX Instruct supports a 32,000 token context window on NVIDIA NIM.
How does NVIDIA NIM compare to other DBRX Instruct providers?
DBRX Instruct is available from 6 providers. The cheapest input pricing is $0.60/1M tokens from DeepInfra.
Who created DBRX Instruct?
DBRX Instruct was created by Databricks Mosaic as part of the DBRX model family.
Is DBRX Instruct open source?
DBRX Instruct's open source status is unknown in the seed data.