Using Qwen2-72B on DeepInfra

Implementation guide · Qwen2 · Alibaba

ServerlessOpen Source

DeepInfra exposes Qwen2-72B through model ID qwen2-72b. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-06-15. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at DeepInfra and generate an API key.
  2. 2
    Use the DeepInfra SDK or REST API to call qwen2-72b — see the documentation for request format.
  3. 3
    You'll be billed $0.45/1M input, $0.65/1M output tokens. See full pricing.

Code Examples

Install
pip install openai
API key
DEEPINFRA_API_KEY
Model ID
qwen2-72b

DeepInfra uses "organization/model-name" format, e.g. "meta-llama/Meta-Llama-3-8B-Instruct" or "mistralai/Mistral-7B-Instruct-v0.3". See the DeepInfra model catalog for exact IDs.

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["DEEPINFRA_API_KEY"],
    base_url="https://api.deepinfra.com/v1/openai"
)
response = client.chat.completions.create(
    model="qwen2-72b",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Pricing on DeepInfra

TypePrice (per 1M)
Input tokens$0.45
Output tokens$0.65

Capabilities

Structured Outputs

About Qwen2-72B

Qwen2-72B is a cutting-edge large language model developed by Alibaba's Qwen team, featuring an impressive 72 billion parameters based on the Transformer architecture 12. It employs advanced enhancements such as SwiGLU activation, attention QKV bias, and group query attention to advance efficiency and precision 16. The model demonstrates strong performance across diverse benchmarks, excelling in language understanding, generation, coding, mathematics, and multilingual tasks, often surpassing other open-source models and challenging proprietary alternatives 34. With support for processing up to 128,000 tokens in context and proficiency in around 30 languages, it offers extensive input capabilities 15.

Model Specs

Released2024-06-05
Parameters72.71B
Context128k
ArchitectureDecoder Only

Provider

DeepInfra

San Francisco, California, United States