WizardLM-2 8x22B on DeepInfra
WizardLM-2 · WizardLM Team
Last refreshed 2026-10-09. Next refresh: weekly.
Why use WizardLM-2 8x22B on DeepInfra?
DeepInfra offers WizardLM-2 8x22B with pay-as-you-go pricing at $0.65/1M input tokens. DeepInfra is a cloud inference platform offering cost-effective access to open-source AI models.
Compare WizardLM-2 8x22B across 6 providers to find the best fit for your use caseSetup recipe
Python + curlpip install openaiexport DEEPINFRA_API_KEY=...import os
from openai import OpenAI
client = OpenAI(
api_key=os.environ["DEEPINFRA_API_KEY"],microsoft/WizardLM-2-8x22BRequest example
import os
from openai import OpenAI
client = OpenAI(
api_key=os.environ["DEEPINFRA_API_KEY"],
base_url="https://api.deepinfra.com/v1/openai"
)
response = client.chat.completions.create(
model="microsoft/WizardLM-2-8x22B",
messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)Gotchas
- Use provider model ID "microsoft/WizardLM-2-8x22B", not the LLMReference slug "wizardlm-2-8x22b".
- DeepInfra uses "organization/model-name" format, e.g. "meta-llama/Meta-Llama-3-8B-Instruct" or "mistralai/Mistral-7B-Instruct-v0.3". See the DeepInfra model catalog for exact IDs.
- The examples expect DEEPINFRA_API_KEY; rename it only if your application config maps the new variable.
Compare WizardLM-2 8x22B Across Providers
| Provider | Input (per 1M) | Output (per 1M) |
|---|---|---|
| DeepInfra | $0.65 | $0.65 |
| Lepton AI API | $0.50 | $0.50 |
| OctoAI API (Deprecated) | — | — |
| Together AI | — | — |
| OpenRouter | $0.62 | $0.62 |
Pricing
| Type | Price (per 1M) |
|---|---|
| Input tokens | $0.65 |
| Output tokens | $0.65 |
Capabilities
About WizardLM-2 8x22B
WizardLM-2 8x22B, developed by WizardLM@Microsoft AI, is a powerful large language model (LLM) featuring 141 billion parameters and utilizing a Mixture of Experts (MoE) architecture. It excels in complex tasks such as chat, multilingual conversations, reasoning, and agent-based interactions. Trained with an AI-powered synthetic system incorporating techniques like Evol-Instruct and AI Align AI, the model surpasses many open-source alternatives. Despite its performance on various benchmarks, further research is essential to address potential biases and enhance reliability post "toxicity testing."