Using Mixtral 8x7B on OctoAI API (Deprecated)

Implementation guide · Mixtral · MistralAI

Open Source

OctoAI API (Deprecated) exposes Mixtral 8x7B through model ID mixtral-8x7b. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-07-11. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at OctoAI API (Deprecated) and generate an API key.
  2. 2
    Use the OctoAI API (Deprecated) SDK or REST API to call mixtral-8x7b.

Code Examples

Code examples for this provider have not been sourced yet.

Pricing on OctoAI API (Deprecated)

Capabilities

No model capability flags are currently sourced.

About Mixtral 8x7B

Mixtral 8x7B, developed by Mistral AI, features a cutting-edge Mixture of Experts (MoE) architecture, utilizing eight experts with seven billion parameters each, yielding a total of 46.7 billion parameters. This architecture activates only two experts per token, allowing for efficient processing and a 6x faster inference rate compared to Llama 2 70B. The model excels in performance, surpassing Llama 2 70B and competing with GPT-3.5 on numerous benchmarks. It supports multiple languages and can handle context up to 32,000 tokens, enhancing understanding of lengthy text.

Model Specs

Released2023-12-11
Parameters8x7B
Context32k
ArchitectureMixture of Experts
Knowledge cutoff2023-12

Provider

OctoAI API (Deprecated)

OctoAI (acquired by NVIDIA)

Seattle, Washington, United States