LLM ReferenceLLM Reference
Together AI

Qwen2-72B on Together AI

Qwen2 · Alibaba

Serverless

Last refreshed 2026-05-11. Next refresh: weekly.

Why use Qwen2-72B on Together AI?

Together AI offers Qwen2-72B with pay-as-you-go pricing at $0.90/1M input tokens. Together AI is a platform for running open-source and proprietary LLMs with fast serverless and dedicated endpoints at competitive inference pricing.

Compare Qwen2-72B across 4 providers to find the best fit for your use case
Input / 1M
$0.90
Output / 1M
$0.90
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install together
Auth
export TOGETHER_API_KEY=...
Call
from together import Together
client = Together()  # reads TOGETHER_API_KEY from env
response = client.chat.completions.create(
    model="qwen2-72b",
Model ID
qwen2-72b

Request example

from together import Together

client = Together()  # reads TOGETHER_API_KEY from env
response = client.chat.completions.create(
    model="qwen2-72b",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Gotchas

  • Together uses "organization/model-name" format, e.g. "meta-llama/Llama-4-Scout-17B-16E-Instruct" or "Qwen/QwQ-32B". See the Together model catalog for the exact ID.
  • The examples expect TOGETHER_API_KEY; rename it only if your application config maps the new variable.

Compare Qwen2-72B Across Providers

ProviderInput (per 1M)Output (per 1M)
Fireworks AI$0.90$0.90
DeepInfra$0.45$0.65
Together AI$0.90$0.90
Microsoft Foundry$1.00$2.00

Pricing

TypePrice (per 1M)
Input tokens$0.90
Output tokens$0.90

Capabilities

Structured Outputs

About Qwen2-72B

Qwen2-72B is a cutting-edge large language model developed by Alibaba's Qwen team, featuring an impressive 72 billion parameters based on the Transformer architecture 12. It employs advanced enhancements such as SwiGLU activation, attention QKV bias, and group query attention to advance efficiency and precision 16. The model demonstrates strong performance across diverse benchmarks, excelling in language understanding, generation, coding, mathematics, and multilingual tasks, often surpassing other open-source models and challenging proprietary alternatives 34. With support for processing up to 128,000 tokens in context and proficiency in around 30 languages, it offers extensive input capabilities 15. However, the base model is not optimal for direct text generation; post-training techniques are advisable for specific applications 16.

FAQ

What does Qwen2-72B cost on Together AI?

On Together AI, Qwen2-72B costs $0.9 per 1M input tokens and $0.9 per 1M output tokens.

What is the context window for Qwen2-72B on Together AI?

Qwen2-72B supports a 128,000 token context window on Together AI.

How does Together AI compare to other Qwen2-72B providers?

Qwen2-72B is available from 4 providers. The cheapest input pricing is $0.45/1M tokens from DeepInfra.

Who created Qwen2-72B?

Qwen2-72B was created by Alibaba as part of the Qwen2 model family.

Is Qwen2-72B open source?

Qwen2-72B is open source under Apache 2.0 according to the seed data.

Get Started

Model Specs

Released2024-06-05
Parameters72.71B
Context128K
ArchitectureDecoder Only