LLM Reference
DeepInfra

DeepInfra DBRX Instruct on DeepInfra

DBRX · Databricks Mosaic

ServerlessOpen Weights

Last refreshed 2026-06-15. Next refresh: weekly.

Why use DeepInfra DBRX Instruct on DeepInfra?

DeepInfra offers DeepInfra DBRX Instruct with pay-as-you-go pricing at $0.60/1M input tokens. DeepInfra is a cloud inference platform offering cost-effective access to open-source AI models.

Input / 1M
$0.60
Output / 1M
$1.20
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install openai
Auth
export DEEPINFRA_API_KEY=...
Call
import os
from openai import OpenAI
client = OpenAI(
    api_key=os.environ["DEEPINFRA_API_KEY"],
Model ID
deepinfra-dbrx-instruct

Request example

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["DEEPINFRA_API_KEY"],
    base_url="https://api.deepinfra.com/v1/openai"
)
response = client.chat.completions.create(
    model="deepinfra-dbrx-instruct",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Gotchas

  • DeepInfra uses "organization/model-name" format, e.g. "meta-llama/Meta-Llama-3-8B-Instruct" or "mistralai/Mistral-7B-Instruct-v0.3". See the DeepInfra model catalog for exact IDs.
  • The examples expect DEEPINFRA_API_KEY; rename it only if your application config maps the new variable.

Pricing

TypePrice (per 1M)
Input tokens$0.60
Output tokens$1.20

Capabilities

Structured Outputs

About DeepInfra DBRX Instruct

DeepInfra DBRX Instruct is Databricks Mosaic's DBRX model. It offers a 32K-token context window.

FAQ

What does DeepInfra DBRX Instruct cost on DeepInfra?

On DeepInfra, DeepInfra DBRX Instruct costs $0.6 per 1M input tokens and $1.2 per 1M output tokens.

What is the context window for DeepInfra DBRX Instruct on DeepInfra?

DeepInfra DBRX Instruct supports a 33k token context window on DeepInfra.

Who created DeepInfra DBRX Instruct?

DeepInfra DBRX Instruct was created by Databricks Mosaic as part of the DBRX model family.

Is DeepInfra DBRX Instruct open source?

DeepInfra DBRX Instruct has open weights under DBRX according to the seed data, but that does not necessarily mean an OSI-approved open-source license.

Get Started

Model Specs

Released2024-03-12
Parameters132B
Context33k
ArchitectureDecoder Only
Knowledge cutoff2023-12

Related Models on DeepInfra