Mixtral 8x7B
- Family
- Mixtral
- Released
- 2023-12-11
- Context
- 32K
- Parameters
- 8x7B
- Architecture
- Mixture of Experts
- Knowledge cutoff
- 2023-12
- Specialization
- general
- Openness
- Open source
- License
- Apache 2.0OSI-approvedPermitted
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
Cheapest of 10 routes · SiliconFlow
Cheapest of 10 routes · SiliconFlow
About
Mixtral 8x7B, developed by Mistral AI, features a cutting-edge Mixture of Experts (MoE) architecture, utilizing eight experts with seven billion parameters each, yielding a total of 46.7 billion parameters. This architecture activates only two experts per token, allowing for efficient processing and a 6x faster inference rate compared to Llama 2 70B. The model excels in performance, surpassing Llama 2 70B and competing with GPT-3.5 on numerous benchmarks. It supports multiple languages and can handle context up to 32,000 tokens, enhancing understanding of lengthy text.
Top use-case fit: coding, agents, and build tasks
Coding
Q/$ AClassification
Q/$ BProviders(10)
Compare all 10Compare API pricing across 10 tracked provider routes for input and output tokens, batch, and cached reads when available.
| Provider | Input / 1M | Output / 1M | Route |
|---|---|---|---|
| SiliconFlow | $0.200 | $0.200 | Serverless |
| Microsoft Foundry | $0.270 | $0.270 | Provisioned |
| Fireworks AI | $0.500 | $0.500 | Serverless |
| Bitdeer AI | $0.180 | $0.540 | Serverless |
| Replicate API | $0.200 | $1.00 | Serverless |
| Vultr | $0.550 | $2.75 | Serverless |
| Alibaba Cloud PAI-EAS | - | - | ServerlessPartial |
| Baseten API | - | - | ServerlessPartial |
| IBM watsonx | - | - | ServerlessPartial |
| Scale AI GenAI Platform | - | - | ServerlessPartial |
Deprecated provider routes(8)
| Provider | Status | Catalog ID |
|---|---|---|
| Databricks Foundation Model Serving | DeprecatedRetired February 27, 2026 | — |
| NVIDIA NIM | DeprecatedRetired July 27, 2026 | — |
| GCP Vertex AI | Deprecated | — |
| AWS Bedrock | Deprecated | — |
| OctoAI API (Deprecated) | Deprecated | — |
| Mistral AI Studio | DeprecatedRetired March 30, 2025 | open-mixtral-8x7b |
| Lepton AI API | Deprecated | — |
| DeepInfra | DeprecatedRetired May 7, 2026 | — |
Available via routers & gateways(16)
LiteLLM
GatewayOpen-source Python SDK and proxy server that unifies 100+ LLM APIs behind a single OpenAI-compatible interface, with load balancing, cost tracking, and configurable failover.
OpenRouter
HybridUnified hybrid gateway to 500+ models from 80+ providers via a single OpenAI-compatible API, with an optional Auto Router that selects a model per prompt from market spend data.
Portkey
GatewayProduction AI gateway routing to 1,600+ LLMs with failover, load balancing, caching, and guardrails; MIT-licensed open-source core is self-hostable. Now part of Palo Alto Networks as Prisma AIRS AI Gateway.
AIRouter
RouterCommercial LLM router (branded "AI Router" on its site) that picks the best model per request via a Decision API or an OpenAI-compatible Chat Completions endpoint, with a private selection mode that routes on anonymized patterns; sold as BYOK subscription plans priced by routed tokens.
Amazon Bedrock Intelligent Prompt Routing
RouterAWS Bedrock's native prompt router that predicts each model's performance per request and routes between two models of the same family (Anthropic Claude, Meta Llama or Amazon Nova).
Azure AI Foundry Model Router
RouterMicrosoft Azure AI Foundry's native model router that uses a trained ML model to route each prompt in real time to the optimal Azure-hosted model, with Balanced/Cost/Quality mode selection and automatic failover.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
Benchmark scores(4)
| Benchmark | Score | Version | Evaluation | Source |
|---|---|---|---|---|
| 54.8 | diamondObserved 2026-03-06 | — | ||
| 90.9 | 10-shotObserved 2026-03-06 | — | ||
| 80.5 | pass@1Observed 2026-03-06 | — | ||
| 80.2 | 5-shotObserved 2026-03-06 | — |
Migration checks
No linked migration route is available for this model yet.