LLM ReferenceLLM Reference
DeepInfra

Dolphin 2.6 Mixtral 8x7B on DeepInfra

Dolphin · Cognitive Computations

Serverless

Last refreshed 2026-05-01. Next refresh: weekly.

Why use Dolphin 2.6 Mixtral 8x7B on DeepInfra?

DeepInfra offers Dolphin 2.6 Mixtral 8x7B with pay-as-you-go pricing at $0.15/1M input tokens. DeepInfra is a cloud inference platform offering cost-effective access to open-source AI models.

Compare Dolphin 2.6 Mixtral 8x7B across 3 providers to find the best fit for your use case
Input / 1M
$0.15
Output / 1M
$0.45
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install openai
Auth
export DEEPINFRA_API_KEY=...
Call
import os
from openai import OpenAI
client = OpenAI(
    api_key=os.environ["DEEPINFRA_API_KEY"],
Model ID
dolphin-2.6-mixtral-8x7b

Request example

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["DEEPINFRA_API_KEY"],
    base_url="https://api.deepinfra.com/v1/openai"
)
response = client.chat.completions.create(
    model="dolphin-2.6-mixtral-8x7b",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Gotchas

  • DeepInfra uses "organization/model-name" format, e.g. "meta-llama/Meta-Llama-3-8B-Instruct" or "mistralai/Mistral-7B-Instruct-v0.3". See the DeepInfra model catalog for exact IDs.
  • The examples expect DEEPINFRA_API_KEY; rename it only if your application config maps the new variable.

Compare Dolphin 2.6 Mixtral 8x7B Across Providers

ProviderInput (per 1M)Output (per 1M)
DeepInfra$0.15$0.45
Lepton AI API$0.30$0.30
Fireworks AI$0.50$0.50

Pricing

TypePrice (per 1M)
Input tokens$0.15
Output tokens$0.45

Capabilities

No model capability flags are currently sourced.

About Dolphin 2.6 Mixtral 8x7B

Dolphin 2.6 Mixtral 8x7B is a large language model fine-tuned from the Mixtral-8x7B base, known for its robust coding abilities and high compliance with user prompts. Despite not being tuned with Direct Preference Optimization, it performs exceptionally well in coding tasks due to extensive training with coding datasets, including MagiCoder. The model's architecture features a context window reduced to 16k, and training was carried out using techniques like qLoRA. However, it is uncensored, exposing potential ethical concerns and prompting caution for deployment without additional safeguards. Quantized versions are available to accommodate different hardware needs, and users may encounter variation in performance with larger context windows.

FAQ

What does Dolphin 2.6 Mixtral 8x7B cost on DeepInfra?

On DeepInfra, Dolphin 2.6 Mixtral 8x7B costs $0.15 per 1M input tokens and $0.45 per 1M output tokens.

How does DeepInfra compare to other Dolphin 2.6 Mixtral 8x7B providers?

Dolphin 2.6 Mixtral 8x7B is available from 3 providers. The cheapest input pricing is $0.15/1M tokens from DeepInfra.

Who created Dolphin 2.6 Mixtral 8x7B?

Dolphin 2.6 Mixtral 8x7B was created by Cognitive Computations as part of the Dolphin model family.

Is Dolphin 2.6 Mixtral 8x7B open source?

Dolphin 2.6 Mixtral 8x7B's open source status is unknown in the seed data.

Get Started

Model Specs

Released2023-12-18
Parameters8x7B
ArchitectureMixture of Experts
Knowledge cutoff2023-12