Using Mixtral 8x7B on NVIDIA NIM

Implementation guide · Mixtral · MistralAI

ProvisionedOpen Source

NVIDIA NIM exposes Mixtral 8x7B through model ID mixtral-8x7b. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-05-01. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at NVIDIA NIM and generate an API key.
  2. 2
    Use the NVIDIA NIM SDK or REST API to call mixtral-8x7b — see the documentation for request format.
  3. 3
    You'll be billed . See full pricing.
API PortalDocumentationPricingModel Card

Code Examples

See NVIDIA NIM documentation for integration details.

Pricing on NVIDIA NIM

Capabilities

No model capability flags are currently sourced.

About Mixtral 8x7B

Mixtral 8x7B, developed by Mistral AI, features a cutting-edge Mixture of Experts (MoE) architecture, utilizing eight experts with seven billion parameters each, yielding a total of 46.7 billion parameters. This architecture activates only two experts per token, allowing for efficient processing and a 6x faster inference rate compared to Llama 2 70B. The model excels in performance, surpassing Llama 2 70B and competing with GPT-3.5 on numerous benchmarks. It supports multiple languages and can handle context up to 32,000 tokens, enhancing understanding of lengthy text.

Full model details →

Model Specs

Released2023-12-11
Parameters8x7B
Context32k
ArchitectureMixture of Experts
Knowledge cutoff2023-12

More Models on NVIDIA NIM

Mixtral 8x22B v0.1
All models on NVIDIA NIM →

Also available on(17)

Mistral AI Studio$0.15/1MBitdeer AI$0.18/1MSiliconFlow$0.20/1M
Compare all providers →

Provider

NVIDIA NIM

NVIDIA

Santa Clara, California, United States