WizardLM-2 Models by Dreamgen
Last refreshed 2026-06-29. Next refresh: weekly.
Details
Capabilities
About
The WizardLM-2 is a family of advanced large language models (LLMs) developed by Microsoft AI. This series includes three cutting-edge models: WizardLM-2 8x22B, WizardLM-2 70B, and WizardLM-2 7B. The flagship model, WizardLM-2 8x22B, is a Mixture of Experts (MoE) architecture with 141 billion parameters, built upon the Mixtral-8x22B-v0.1 base model. These models demonstrate highly competitive performance in complex chat, multilingual tasks, reasoning, and agent-based interactions, often rivaling or surpassing proprietary models in benchmarks like MT-Bench. The WizardLM-2 family was trained using a fully AI-powered synthetic training system, which contributes to their advanced capabilities in various domains including writing, coding, mathematics, and multilingual tasks.
Decision facts
- Best fit
- structured outputscodingmath-heavy prompts
- Capability starting point
- Together AI WizardLM-2-8x22B with 33k context and structured outputs
- Lowest tracked input
- WizardLM-2 7B · $0.05/1M · DeepInfra
- Closest related family
- MOSS-Audio
Current Variants
Use-when guidance is based on each model's tracked capabilities, context window, release date, and replacement status.
Use when the workload needs 7B parameters and structured outputs.
Use when the workload needs 33k context, 176B parameters, and structured outputs.
| Model | Use when | Released | Signals | Status |
|---|---|---|---|---|
| WizardLM-2 8x22B | Use when the workload needs structured outputs. | 2024-01 | structured outputs | Current |
| WizardLM-2 70B | Use when the workload needs 70B parameters. | 2024-01 | 70B parameters | Current |
| WizardLM-2 7B | Use when the workload needs 7B parameters and structured outputs. | 2024-01 | 7B parametersstructured outputs | Current |
| Together AI WizardLM-2-8x22B | Use when the workload needs 33k context, 176B parameters, and structured outputs. | 2024-01 | 33k context176B parametersstructured outputs | Current |
Release Timeline
1 release groupSpecifications(4 models)
| Model | Released | Context | Parameters | Structured Outputs |
|---|---|---|---|---|
| WizardLM-2 8x22B | 2024-01 | — | 8x22B | Yes |
| WizardLM-2 70B | 2024-01 | — | 70B | No |
| WizardLM-2 7B | 2024-01 | — | 7B | Yes |
| Together AI WizardLM-2-8x22B | 2024-01 | 33k | 176B | Yes |
Available From(6 providers)
Pricing
| Model | Provider | Input / 1M | Output / 1M | Type |
|---|---|---|---|---|
| WizardLM-2 7B | DeepInfra | $0.05 | $0.15 | Serverless |
| WizardLM-2 7B | Lepton AI API | $0.07 | $0.07 | Serverless |
| WizardLM-2 8x22B | Lepton AI API | $0.5 | $0.5 | Serverless |
| WizardLM-2 8x22B | OpenRouter | $0.62 | $0.62 | Serverless |
| WizardLM-2 8x22B | Novita AI | $0.62 | $0.62 | Serverless |
| WizardLM-2 8x22B | DeepInfra | $0.65 | $0.65 | Serverless |
| Together AI WizardLM-2-8x22B | Together AI | $1 | $1.5 | Serverless |
