Using WizardLM-2 7B on Lepton AI API

Implementation guide · WizardLM-2 · Dreamgen

ServerlessOpen Source

Lepton AI API exposes WizardLM-2 7B through model ID wizardlm-2-7b. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-06-29. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at Lepton AI API and generate an API key.
  2. 2
    Use the Lepton AI API SDK or REST API to call wizardlm-2-7b — see the documentation for request format.
  3. 3
    You'll be billed $0.07/1M input, $0.07/1M output tokens. See full pricing.
API PortalDocumentationPricing

Code Examples

See Lepton AI API documentation for integration details.

Pricing on Lepton AI API

TypePrice (per 1M)
Input tokens$0.07
Output tokens$0.07

Capabilities

Structured Outputs

About WizardLM-2 7B

WizardLM-2 7B is a large language model developed by WizardLM in collaboration with Microsoft AI. It is part of the WizardLM-2 family, which includes larger models but is notable for its quick processing speed, achieving performance comparable to open-source models that are much larger. This multilingual model can process diverse input types, such as natural language text, code, and mathematical expressions. It showcases capabilities in text generation, question answering, summarization, as well as code generation and mathematical problem-solving.

Full model details →

Model Specs

Released2024-01-09
Parameters7B
ArchitectureDecoder Only

More Models on Lepton AI API

WizardLM-2 8x22B
All models on Lepton AI API →

Also available on(1)

DeepInfra$0.05/1M
Compare all providers →

Provider

Lepton AI API

Lepton AI

Sacramento, California, United States