Using DBRX Instruct on NVIDIA NIM
Implementation guide · DBRX · Databricks Mosaic
NVIDIA NIM exposes DBRX Instruct through model ID dbrx-instruct. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.
Last refreshed 2026-05-01. Next refresh: weekly.
Quick Start
- 1
- 2Use the NVIDIA NIM SDK or REST API to call
dbrx-instruct— see the documentation for request format. - 3
Code Examples
Pricing on NVIDIA NIM
Capabilities
About DBRX Instruct
DBRX Instruct, developed by Databricks, is a cutting-edge large language model designed for various natural language processing tasks. It excels in text summarization, question answering, information extraction, and code generation, utilizing a fine-grained mixture-of-experts architecture with 132 billion parameters. With advanced features like rotary position encodings, gated linear units, and grouped query attention, it performs exceptionally across multiple benchmarks, even outperforming some closed-source models. Trained on a vast 12 trillion token dataset, it supports contexts up to 32,000 tokens. Although primarily effective in English, its multilingual strength isn't fully explored.