Using Dolphin 2.6 Mixtral 8x7B on Lepton AI API

Implementation guide · Dolphin · Cognitive Computations

ServerlessOpen Source

Lepton AI API exposes Dolphin 2.6 Mixtral 8x7B through model ID dolphin-2.6-mixtral-8x7b. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-05-19. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at Lepton AI API and generate an API key.
  2. 2
    Use the Lepton AI API SDK or REST API to call dolphin-2.6-mixtral-8x7b — see the documentation for request format.
  3. 3
    You'll be billed $0.30/1M input, $0.30/1M output tokens. See full pricing.
API PortalDocumentationPricing

Code Examples

See Lepton AI API documentation for integration details.

Pricing on Lepton AI API

TypePrice (per 1M)
Input tokens$0.30
Output tokens$0.30

Capabilities

No model capability flags are currently sourced.

About Dolphin 2.6 Mixtral 8x7B

Dolphin 2.6 Mixtral 8x7B is a large language model fine-tuned from the Mixtral-8x7B base, known for its robust coding abilities and high compliance with user prompts. Despite not being tuned with Direct Preference Optimization, it performs exceptionally well in coding tasks due to extensive training with coding datasets, including MagiCoder. The model's architecture features a context window reduced to 16k, and training was carried out using techniques like qLoRA. However, it is uncensored, exposing potential ethical concerns and prompting caution for deployment without additional safeguards.

Full model details →

Model Specs

Released2023-12-18
Parameters8x7B
Context32k
ArchitectureMixture of Experts
Knowledge cutoff2023-12

Also available on(2)

DeepInfra$0.15/1MFireworks AI$0.50/1M
Compare all providers →

Provider

Lepton AI API

Lepton AI

Sacramento, California, United States