LLM Reference
Fireworks AI

DBRX Instruct on Fireworks AI

DBRX · Databricks Mosaic

Serverless

Pricing

TypePrice (per 1M)
Input tokens$1.20
Output tokens$1.20

Capabilities

VisionMultimodalReasoningFunction CallingTool UseJSON ModeCode Execution

About DBRX Instruct

DBRX Instruct, developed by Databricks, is a cutting-edge large language model designed for various natural language processing tasks. It excels in text summarization, question answering, information extraction, and code generation, utilizing a fine-grained mixture-of-experts architecture with 132 billion parameters. With advanced features like rotary position encodings, gated linear units, and grouped query attention, it performs exceptionally across multiple benchmarks, even outperforming some closed-source models. Trained on a vast 12 trillion token dataset, it supports contexts up to 32,000 tokens. Although primarily effective in English, its multilingual strength isn't fully explored. Users should be cautious as it may generate inaccurate or biased outputs.

Get Started

Model Specs

Released2024-03-27
Parameters132B
Context32K
ArchitectureMixture of Experts

Related Models on Fireworks AI