LLM ReferenceLLM Reference
DeepInfra

Qwen2-72B on DeepInfra

Qwen2 · Alibaba

Serverless

Last refreshed 2026-04-24. Next refresh: weekly.

Why use Qwen2-72B on DeepInfra?

DeepInfra offers Qwen2-72B with pay-as-you-go pricing at $0.45/1M input tokens. DeepInfra is a cloud inference platform offering cost-effective access to open-source AI models.

Compare Qwen2-72B across 4 providers to find the best fit for your use case
Input / 1M
$0.45
Output / 1M
$0.65
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install openai
Auth
export DEEPINFRA_API_KEY=...
Call
import os
from openai import OpenAI
client = OpenAI(
    api_key=os.environ["DEEPINFRA_API_KEY"],
Model ID
qwen2-72b

Request example

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["DEEPINFRA_API_KEY"],
    base_url="https://api.deepinfra.com/v1/openai"
)
response = client.chat.completions.create(
    model="qwen2-72b",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Gotchas

  • DeepInfra uses "organization/model-name" format, e.g. "meta-llama/Meta-Llama-3-8B-Instruct" or "mistralai/Mistral-7B-Instruct-v0.3". See the DeepInfra model catalog for exact IDs.
  • The examples expect DEEPINFRA_API_KEY; rename it only if your application config maps the new variable.

Compare Qwen2-72B Across Providers

ProviderInput (per 1M)Output (per 1M)
Fireworks AI$0.90$0.90
DeepInfra$0.45$0.65
Together AI$0.90$0.90
Microsoft Foundry$1.00$2.00

Pricing

TypePrice (per 1M)
Input tokens$0.45
Output tokens$0.65

Capabilities

Structured Outputs

About Qwen2-72B

Qwen2-72B is a cutting-edge large language model developed by Alibaba's Qwen team, featuring an impressive 72 billion parameters based on the Transformer architecture 12. It employs advanced enhancements such as SwiGLU activation, attention QKV bias, and group query attention to advance efficiency and precision 16. The model demonstrates strong performance across diverse benchmarks, excelling in language understanding, generation, coding, mathematics, and multilingual tasks, often surpassing other open-source models and challenging proprietary alternatives 34. With support for processing up to 128,000 tokens in context and proficiency in around 30 languages, it offers extensive input capabilities 15. However, the base model is not optimal for direct text generation; post-training techniques are advisable for specific applications 16.

FAQ

What does Qwen2-72B cost on DeepInfra?

On DeepInfra, Qwen2-72B costs $0.45 per 1M input tokens and $0.65 per 1M output tokens.

What is the context window for Qwen2-72B on DeepInfra?

Qwen2-72B supports a 128,000 token context window on DeepInfra.

How does DeepInfra compare to other Qwen2-72B providers?

Qwen2-72B is available from 4 providers. The cheapest input pricing is $0.45/1M tokens from DeepInfra.

Who created Qwen2-72B?

Qwen2-72B was created by Alibaba as part of the Qwen2 model family.

Is Qwen2-72B open source?

Qwen2-72B is open source under Apache 2.0 according to the seed data.

Get Started

Model Specs

Released2024-06-05
Parameters72.71B
Context128K
ArchitectureDecoder Only

Related Models on DeepInfra