Dolphin 2.5 Mixtral 8x7B on Together AI

Dolphin · Cognitive Computations

ServerlessOpen Source

Last refreshed 2026-06-15. Next refresh: weekly.

Why use Dolphin 2.5 Mixtral 8x7B on Together AI?

Together AI offers Dolphin 2.5 Mixtral 8x7B with pay-as-you-go pricing at $0.60/1M input tokens. Together AI is a platform for running open-source and proprietary LLMs with fast serverless and dedicated endpoints at competitive inference pricing.

Input / 1M
$0.60
Output / 1M
$0.60
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install together
Auth
export TOGETHER_API_KEY=...
Call
from together import Together
client = Together()  # reads TOGETHER_API_KEY from env
response = client.chat.completions.create(
    model="dolphin-2.5-mixtral-8x7b",
Model ID
dolphin-2.5-mixtral-8x7b

Request example

from together import Together

client = Together()  # reads TOGETHER_API_KEY from env
response = client.chat.completions.create(
    model="dolphin-2.5-mixtral-8x7b",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Gotchas

  • Together uses "organization/model-name" format, e.g. "meta-llama/Llama-4-Scout-17B-16E-Instruct" or "Qwen/QwQ-32B". See the Together model catalog for the exact ID.
  • The examples expect TOGETHER_API_KEY; rename it only if your application config maps the new variable.

Pricing

TypePrice (per 1M)
Input tokens$0.60
Output tokens$0.60

Capabilities

No model capability flags are currently sourced.

About Dolphin 2.5 Mixtral 8x7B

The Dolphin 2.5 Mixtral 8x7B is a sophisticated large language model designed primarily for coding tasks, known for its proficiency across diverse programming languages including Kotlin. It utilizes the Mixtral-8x7b architecture and has been fine-tuned on datasets like Dolphin-Coder and MagiCoder, employing qLoRA and Axolotl during training. Featuring a 16k context window for fine-tuning and a base context window of 32k, it offers powerful yet uncensored capabilities, allowing it to handle a wide range of prompts, albeit this introduces ethical considerations.

Get Started

Model Specs

Released2023-12-18
Parameters8x7B
Context32k
ArchitectureMixture of Experts
Knowledge cutoff2023-12