WizardLM-2 8x22B on Together AI

WizardLM-2 · WizardLM Team

ServerlessOpen Source

Last refreshed 2026-10-09. Next refresh: weekly.

Why use WizardLM-2 8x22B on Together AI?

Together AI offers WizardLM-2 8x22B with competitive pricing. Together AI is a platform for running open-source and proprietary LLMs with fast serverless and dedicated endpoints at competitive inference pricing.

Compare WizardLM-2 8x22B across 6 providers to find the best fit for your use case
Input / 1M
-
Output / 1M
-
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install together
Auth
export TOGETHER_API_KEY=...
Call
from together import Together
client = Together()  # reads TOGETHER_API_KEY from env
response = client.chat.completions.create(
    model="wizardlm-2-8x22b",
Model ID
wizardlm-2-8x22b

Request example

from together import Together

client = Together()  # reads TOGETHER_API_KEY from env
response = client.chat.completions.create(
    model="wizardlm-2-8x22b",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Gotchas

  • Together uses "organization/model-name" format, e.g. "meta-llama/Llama-4-Scout-17B-16E-Instruct" or "Qwen/QwQ-32B". See the Together model catalog for the exact ID.
  • The examples expect TOGETHER_API_KEY; rename it only if your application config maps the new variable.

Compare WizardLM-2 8x22B Across Providers

ProviderInput (per 1M)Output (per 1M)
DeepInfra$0.65$0.65
Lepton AI API$0.50$0.50
OctoAI API (Deprecated)——
Together AI——
OpenRouter$0.62$0.62
View all 6 providers →

Capabilities

Structured Outputs

About WizardLM-2 8x22B

WizardLM-2 8x22B, developed by WizardLM@Microsoft AI, is a powerful large language model (LLM) featuring 141 billion parameters and utilizing a Mixture of Experts (MoE) architecture. It excels in complex tasks such as chat, multilingual conversations, reasoning, and agent-based interactions. Trained with an AI-powered synthetic system incorporating techniques like Evol-Instruct and AI Align AI, the model surpasses many open-source alternatives. Despite its performance on various benchmarks, further research is essential to address potential biases and enhance reliability post "toxicity testing."

Get Started