LLM ReferenceLLM Reference
DeepInfra

WizardLM-2 8x22B on DeepInfra

WizardLM-2 · Dreamgen

Serverless

Last refreshed 2026-04-24. Next refresh: weekly.

Why use WizardLM-2 8x22B on DeepInfra?

DeepInfra offers WizardLM-2 8x22B with pay-as-you-go pricing at $0.65/1M input tokens. DeepInfra is a cloud inference platform offering cost-effective access to open-source AI models.

Compare WizardLM-2 8x22B across 4 providers to find the best fit for your use case
Input / 1M
$0.65
Output / 1M
$0.65
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install openai
Auth
export DEEPINFRA_API_KEY=...
Call
import os
from openai import OpenAI
client = OpenAI(
    api_key=os.environ["DEEPINFRA_API_KEY"],
Model ID
wizardlm-2-8x22b

Request example

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["DEEPINFRA_API_KEY"],
    base_url="https://api.deepinfra.com/v1/openai"
)
response = client.chat.completions.create(
    model="wizardlm-2-8x22b",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Gotchas

  • DeepInfra uses "organization/model-name" format, e.g. "meta-llama/Meta-Llama-3-8B-Instruct" or "mistralai/Mistral-7B-Instruct-v0.3". See the DeepInfra model catalog for exact IDs.
  • The examples expect DEEPINFRA_API_KEY; rename it only if your application config maps the new variable.

Compare WizardLM-2 8x22B Across Providers

ProviderInput (per 1M)Output (per 1M)
DeepInfra$0.65$0.65
Lepton AI API$0.50$0.50
OctoAI API (Deprecated)$1.20$1.20
OpenRouter$0.62$0.62

Pricing

TypePrice (per 1M)
Input tokens$0.65
Output tokens$0.65

Capabilities

Structured Outputs

About WizardLM-2 8x22B

WizardLM-2 8x22B, developed by WizardLM@Microsoft AI, is a powerful large language model (LLM) featuring 141 billion parameters and utilizing a Mixture of Experts (MoE) architecture. It excels in complex tasks such as chat, multilingual conversations, reasoning, and agent-based interactions. Trained with an AI-powered synthetic system incorporating techniques like Evol-Instruct and AI Align AI, the model surpasses many open-source alternatives. Despite its performance on various benchmarks, further research is essential to address potential biases and enhance reliability post "toxicity testing."

FAQ

What does WizardLM-2 8x22B cost on DeepInfra?

On DeepInfra, WizardLM-2 8x22B costs $0.65 per 1M input tokens and $0.65 per 1M output tokens.

How does DeepInfra compare to other WizardLM-2 8x22B providers?

WizardLM-2 8x22B is available from 4 providers. The cheapest input pricing is $0.50/1M tokens from Lepton AI API.

Who created WizardLM-2 8x22B?

WizardLM-2 8x22B was created by Dreamgen as part of the WizardLM-2 model family.

Is WizardLM-2 8x22B open source?

WizardLM-2 8x22B's open source status is unknown in the seed data.

Get Started

Model Specs

Released2024-01-09
Parameters8x22B
ArchitectureMixture of Experts

Related Models on DeepInfra