DBRX
About
The DBRX family of large language models (LLMs), developed by Databricks, includes DBRX Base and DBRX Instruct, both of which have been released under an open license. These transformer-based, decoder-only models employ a distinguished fine-grained mixture-of-experts (MoE) architecture. This approach leverages a larger number of smaller expert networks, enhancing the quality of output compared to models with fewer, larger experts. Trained on an extensive dataset of 12 trillion tokens encompassing text and code, these models showcase high performance with the capability to handle up to 32,000 tokens of context. DBRX Instruct is specially optimized for few-turn interactions, making it suitable for efficient conversational applications. The DBRX models not only excel in efficiency during training and inference but also outperform many leading closed and open-source models in various benchmarks. They are accessible for download on Hugging Face and integrated through Databricks' Foundation Model APIs.
Specifications(7 models)
| Model | Released | Context | Parameters | Structured Outputs |
|---|---|---|---|---|
| DBRX Expanse | 2024-11 | 32k | 229B | No |
| DBRX Instruct 20B | 2024-07 | 32k | 20B | No |
| DBRX | 2024-03 | 32K | 132B | No |
| DeepInfra DBRX Instruct | 2024-03 | 33K | 132B | Yes |
| Fireworks DBRX-Instruct | 2024-03 | 33K | 132B | No |
| DBRX Base | 2024-03 | 32k | 132B | No |
Available From(6 providers)
Pricing
| Model | Provider | Input / 1M | Output / 1M | Type |
|---|---|---|---|---|
| DeepInfra DBRX Instruct | DeepInfra | $0.6 | $1.2 | Serverless |
| Fireworks DBRX-Instruct | Fireworks AI | $1.5 | $1.5 | Serverless |
Frequently Asked Questions
- What is DBRX?
- The DBRX family of large language models (LLMs), developed by Databricks, includes DBRX Base and DBRX Instruct, both of which have been released under an open license. These transformer-based, decoder-only models employ a distinguished fine-grained mixture-of-experts (MoE) architecture. This approach leverages a larger number of smaller expert networks, enhancing the quality of output compared to models with fewer, larger experts. Trained on an extensive dataset of 12 trillion tokens encompassing text and code, these models showcase high performance with the capability to handle up to 32,000 tokens of context. DBRX Instruct is specially optimized for few-turn interactions, making it suitable for efficient conversational applications. The DBRX models not only excel in efficiency during training and inference but also outperform many leading closed and open-source models in various benchmarks. They are accessible for download on Hugging Face and integrated through Databricks' Foundation Model APIs.
- How many models are in the DBRX family?
- The DBRX family contains 7 models.
- What is the latest DBRX model?
- The latest model is DBRX Expanse, released in 2024-11.
- How much does DBRX cost?
- DBRX models range from $0.6/1M to $2.7/1M input tokens depending on the model and provider.
