DeepInfra exposes WizardLM-2 7B through model ID wizardlm-2-7b. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.
Last refreshed 2026-06-29. Next refresh: weekly.
Quick Start
- 1
- 2
- 3
Code Examples
pip install openaiDEEPINFRA_API_KEYwizardlm-2-7bDeepInfra uses "organization/model-name" format, e.g. "meta-llama/Meta-Llama-3-8B-Instruct" or "mistralai/Mistral-7B-Instruct-v0.3". See the DeepInfra model catalog for exact IDs.
import os
from openai import OpenAI
client = OpenAI(
api_key=os.environ["DEEPINFRA_API_KEY"],
base_url="https://api.deepinfra.com/v1/openai"
)
response = client.chat.completions.create(
model="wizardlm-2-7b",
messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)Pricing on DeepInfra
| Type | Price (per 1M) |
|---|---|
| Input tokens | $0.05 |
| Output tokens | $0.15 |
Capabilities
About WizardLM-2 7B
WizardLM-2 7B is a large language model developed by WizardLM in collaboration with Microsoft AI. It is part of the WizardLM-2 family, which includes larger models but is notable for its quick processing speed, achieving performance comparable to open-source models that are much larger. This multilingual model can process diverse input types, such as natural language text, code, and mathematical expressions. It showcases capabilities in text generation, question answering, summarization, as well as code generation and mathematical problem-solving.