Using WizardLM-2 8x22B on Together AI
Implementation guide · WizardLM-2 · WizardLM Team
Together AI exposes WizardLM-2 8x22B through model ID wizardlm-2-8x22b. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.
Last refreshed 2026-10-09. Next refresh: weekly.
Quick Start
- 1
- 2Use the Together AI SDK or REST API to call
wizardlm-2-8x22b— see the documentation for request format.
Code Examples
pip install togetherTOGETHER_API_KEYwizardlm-2-8x22bTogether uses "organization/model-name" format, e.g. "meta-llama/Llama-4-Scout-17B-16E-Instruct" or "Qwen/QwQ-32B". See the Together model catalog for the exact ID.
from together import Together
client = Together() # reads TOGETHER_API_KEY from env
response = client.chat.completions.create(
model="wizardlm-2-8x22b",
messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)Pricing on Together AI
Capabilities
About WizardLM-2 8x22B
WizardLM-2 8x22B, developed by WizardLM@Microsoft AI, is a powerful large language model (LLM) featuring 141 billion parameters and utilizing a Mixture of Experts (MoE) architecture. It excels in complex tasks such as chat, multilingual conversations, reasoning, and agent-based interactions. Trained with an AI-powered synthetic system incorporating techniques like Evol-Instruct and AI Align AI, the model surpasses many open-source alternatives. Despite its performance on various benchmarks, further research is essential to address potential biases and enhance reliability post "toxicity testing."