Using WizardLM-2 8x22B on OctoAI API (Deprecated)

Implementation guide · WizardLM-2 · Dreamgen

Open Source

OctoAI API (Deprecated) exposes WizardLM-2 8x22B through model ID wizardlm-2-8x22b. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-07-11. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at OctoAI API (Deprecated) and generate an API key.
  2. 2
    Use the OctoAI API (Deprecated) SDK or REST API to call wizardlm-2-8x22b.

Code Examples

Code examples for this provider have not been sourced yet.

Pricing on OctoAI API (Deprecated)

Capabilities

Structured Outputs

About WizardLM-2 8x22B

WizardLM-2 8x22B, developed by WizardLM@Microsoft AI, is a powerful large language model (LLM) featuring 141 billion parameters and utilizing a Mixture of Experts (MoE) architecture. It excels in complex tasks such as chat, multilingual conversations, reasoning, and agent-based interactions. Trained with an AI-powered synthetic system incorporating techniques like Evol-Instruct and AI Align AI, the model surpasses many open-source alternatives. Despite its performance on various benchmarks, further research is essential to address potential biases and enhance reliability post "toxicity testing."

Full model details →

Model Specs

Released2024-01-09
Parameters8x22B
ArchitectureMixture of Experts

Also available on(4)

Lepton AI API$0.50/1MOpenRouter$0.62/1MNovita AI$0.62/1M
Compare all providers →

Provider

OctoAI API (Deprecated)

OctoAI (acquired by NVIDIA)

Seattle, Washington, United States