Using Dolphin 2.6 Mixtral 8x7B on Fireworks AI

Implementation guide · Dolphin · Cognitive Computations

ProvisionedOpen Source

Fireworks AI exposes Dolphin 2.6 Mixtral 8x7B through model ID accounts/fireworks/models/dolphin-2p6-mixtral-8x7b. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-05-19. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at Fireworks AI and generate an API key.
  2. 2
    Use the Fireworks AI SDK or REST API to call accounts/fireworks/models/dolphin-2p6-mixtral-8x7b — see the documentation for request format.
  3. 3
    You'll be billed $0.50/1M input, $0.50/1M output tokens. See full pricing.

Code Examples

Install
pip install openai
API key
FIREWORKS_API_KEY
Model ID
accounts/fireworks/models/dolphin-2p6-mixtral-8x7b

Fireworks model IDs use "accounts/fireworks/models/{model-name}" format, e.g. "accounts/fireworks/models/llama4-scout-instruct-basic" or "accounts/fireworks/models/deepseek-r1".

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["FIREWORKS_API_KEY"],
    base_url="https://api.fireworks.ai/inference/v1"
)
response = client.chat.completions.create(
    model="accounts/fireworks/models/dolphin-2p6-mixtral-8x7b",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Pricing on Fireworks AI

TypePrice (per 1M)
Input tokens$0.50
Output tokens$0.50

Capabilities

No model capability flags are currently sourced.

About Dolphin 2.6 Mixtral 8x7B

Dolphin 2.6 Mixtral 8x7B is a large language model fine-tuned from the Mixtral-8x7B base, known for its robust coding abilities and high compliance with user prompts. Despite not being tuned with Direct Preference Optimization, it performs exceptionally well in coding tasks due to extensive training with coding datasets, including MagiCoder. The model's architecture features a context window reduced to 16k, and training was carried out using techniques like qLoRA. However, it is uncensored, exposing potential ethical concerns and prompting caution for deployment without additional safeguards.

Model Specs

Released2023-12-18
Parameters8x7B
Context32k
ArchitectureMixture of Experts
Knowledge cutoff2023-12

Provider

Fireworks AI

San Mateo, California, United States