LLM Reference

WizardLM-2 8x22B

Released
2024-01-09
Last refreshed
2026-07-11
Status
Researched 93d ago
Open sourceCommercial use: permittedCodingClassificationJSON / Tool use

WizardLM-2 8x22B is worth evaluating for coding, classification, and json / tool use when its provider route and context window match the workload.

Use it for

  • Teams evaluating coding, classification, and json / tool use
  • Buyers comparing 4 tracked provider routes

Do not use it for

  • Vision or document-understanding workloads
Specifications
Released
2024-01-09
Parameters
8x22B
Architecture
Mixture of Experts
Specialization
general
Openness
Open source
License
Apache 2.0OSI-approvedCommercial use: permitted
Weights
Unknown
Code
Unknown
Training
Fine-tuned
Created by

Unrestricted AI role-play and story generator

N/A
Founded N/A
Website
Pricing
Output / 1M
$0.500
Input / 1M
$0.500

Cheapest of 5 routes · Lepton AI API

About

WizardLM-2 8x22B, developed by WizardLM@Microsoft AI, is a powerful large language model (LLM) featuring 141 billion parameters and utilizing a Mixture of Experts (MoE) architecture. It excels in complex tasks such as chat, multilingual conversations, reasoning, and agent-based interactions. Trained with an AI-powered synthetic system incorporating techniques like Evol-Instruct and AI Align AI, the model surpasses many open-source alternatives. Despite its performance on various benchmarks, further research is essential to address potential biases and enhance reliability post "toxicity testing."

Top use-case fit: coding, agents, and build tasks

Coding

Q/$ B

1 relevant benchmark in the decision map.

Classification

Q/$ C

1 relevant benchmark in the decision map.

JSON / Tool use

Included by capability and metadata signals in the decision map.

Provider price ladder

Compare all 5

Compare API pricing across 4 providers for input and output tokens, batch, and cached reads when available.

ProviderInput / 1MOutput / 1MRoute
Lepton AI API$0.500$0.500
Serverless
Novita AI$0.620$0.620
Serverless
OpenRouter$0.620$0.620
Serverless
DeepInfra$0.650$0.650
Serverless

Capabilities

Structured Outputs

Benchmark peer barsfor Coding

Benchmark scores(2)

Scores are benchmark-specific and are direction-aware: the same numeric gap can mean very different outcomes across suites. Use the leaderboard context and this model's provider route to decide whether the winning margin is meaningful for your workload.
BenchmarkScoreVersionEvaluationSource
HumanEval67.5pass@1Observed 2026-03-06Source
Massive Multitask Language Understanding76.95-shotObserved 2026-03-06Source

Migration checks

No linked migration route is available for this model yet.