LLM ReferenceLLM Reference
DeepInfra

DeepInfra DBRX Instruct on DeepInfra

DBRX · Databricks Mosaic

Serverless

Last refreshed 2026-04-24. Next refresh: weekly.

Why use DeepInfra DBRX Instruct on DeepInfra?

DeepInfra offers DeepInfra DBRX Instruct with pay-as-you-go pricing at $0.60/1M input tokens. DeepInfra is a cloud inference platform offering cost-effective access to open-source AI models.

Input / 1M
$0.60
Output / 1M
$1.20
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install openai
Auth
export DEEPINFRA_API_KEY=...
Call
import os
from openai import OpenAI
client = OpenAI(
    api_key=os.environ["DEEPINFRA_API_KEY"],
Model ID
deepinfra-dbrx-instruct

Request example

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["DEEPINFRA_API_KEY"],
    base_url="https://api.deepinfra.com/v1/openai"
)
response = client.chat.completions.create(
    model="deepinfra-dbrx-instruct",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Gotchas

  • DeepInfra uses "organization/model-name" format, e.g. "meta-llama/Meta-Llama-3-8B-Instruct" or "mistralai/Mistral-7B-Instruct-v0.3". See the DeepInfra model catalog for exact IDs.
  • The examples expect DEEPINFRA_API_KEY; rename it only if your application config maps the new variable.

Pricing

TypePrice (per 1M)
Input tokens$0.60
Output tokens$1.20

Capabilities

Structured Outputs

About DeepInfra DBRX Instruct

Databricks DBRX Instruct via DeepInfra

FAQ

What does DeepInfra DBRX Instruct cost on DeepInfra?

On DeepInfra, DeepInfra DBRX Instruct costs $0.6 per 1M input tokens and $1.2 per 1M output tokens.

What is the context window for DeepInfra DBRX Instruct on DeepInfra?

DeepInfra DBRX Instruct supports a 32,768 token context window on DeepInfra.

Who created DeepInfra DBRX Instruct?

DeepInfra DBRX Instruct was created by Databricks Mosaic as part of the DBRX model family.

Is DeepInfra DBRX Instruct open source?

DeepInfra DBRX Instruct is not open source; the seed data lists it as proprietary.

Get Started

Model Specs

Released2024-03-12
Parameters132B
Context33K
ArchitectureDecoder Only

Related Models on DeepInfra