Quick Start
- 1Create an account at OctoAI API (Deprecated) and generate an API key.
- 2Use the OctoAI API (Deprecated) SDK or REST API to call
mixtral-8x7b.
Code Examples
About OctoAI API (Deprecated)
No public independent OctoAI API, model catalog, portal, documentation, or pricing surface was verified on the former OctoAI routes checked. Those routes redirect to NVIDIA’s general site; do not treat that site as a successor to the former OctoAI API.
OctoAI was a hosted inference platform for running third-party foundation models. OctoAI’s company profile states that NVIDIA acquired it in September 2024 and that it was dissolved as an independent corporate entity. This entry is retained only as historical provider coverage.
Pricing on OctoAI API (Deprecated)
Capabilities
No model capability flags are currently sourced.
About Mixtral 8x7B
Mixtral 8x7B, developed by Mistral AI, features a cutting-edge Mixture of Experts (MoE) architecture, utilizing eight experts with seven billion parameters each, yielding a total of 46.7 billion parameters. This architecture activates only two experts per token, allowing for efficient processing and a 6x faster inference rate compared to Llama 2 70B. The model excels in performance, surpassing Llama 2 70B and competing with GPT-3.5 on numerous benchmarks. It supports multiple languages and can handle context up to 32,000 tokens, enhancing understanding of lengthy text. Designed for diverse tasks, it is strong in code generation and available under a permissive Apache 2.0 license, promoting community engagement. Compatible with various optimization tools, its weights are easily deployable, with Mistral AI continuing to improve its capabilities through performance optimizations and fine-tuning efforts.