Qwen2-72B
Qwen2-72B is worth evaluating for coding, rag, and long context when its provider route and context window match the workload.
Use it for
- Teams evaluating coding, rag, and long context
- Workloads that can use a 128k context window
- Buyers comparing 4 tracked provider routes
Do not use it for
- Vision or document-understanding workloads
- Family
- Qwen2
- Released
- 2024-06-05
- Context
- 128k
- Parameters
- 72.71B
- Architecture
- Decoder Only
- Specialization
- general
- Training
- finetuned
Cheapest of 4 routes · DeepInfra
About
Qwen2-72B is a cutting-edge large language model developed by Alibaba's Qwen team, featuring an impressive 72 billion parameters based on the Transformer architecture 12. It employs advanced enhancements such as SwiGLU activation, attention QKV bias, and group query attention to advance efficiency and precision 16. The model demonstrates strong performance across diverse benchmarks, excelling in language understanding, generation, coding, mathematics, and multilingual tasks, often surpassing other open-source models and challenging proprietary alternatives 34. With support for processing up to 128,000 tokens in context and proficiency in around 30 languages, it offers extensive input capabilities 15. However, the base model is not optimal for direct text generation; post-training techniques are advisable for specific applications 16.
Qwen2-72B is a model in the Qwen2 family. The structured metadata tracks a 128k-token context window and structured outputs. This page tracks provider routes through Fireworks AI, DeepInfra, Together AI, and 1 more, with the cheapest tracked route listed at $0.45 input and $0.65 output per 1M tokens. Headline tracked benchmarks include HumanEval 67.1, Massive Multitask Language Understanding 84.2, and MMLU PRO 64.4.
Top use-case fit: coding, agents, and build tasks
Coding
Q/$ C1 relevant benchmark in the decision map.
RAG
Included by capability and metadata signals in the decision map.
Long context
Included by capability and metadata signals in the decision map.
Provider price ladder
Compare all 4Compare API pricing across 4 providers for input and output tokens, batch, and cached reads when available.
| Provider | Input / 1M | Output / 1M | Route |
|---|---|---|---|
| DeepInfra | $0.450 | $0.650 | Serverless |
| Fireworks AI | $0.900 | $0.900 | Serverless |
| Together AI | $0.900 | $0.900 | Serverless |
| Microsoft Foundry | $1.00 | $2.00 | Provisioned |
Capabilities
Benchmark peer barsfor Coding
Benchmark scores(3)
| Benchmark | Score | Version | Source |
|---|---|---|---|
| HumanEval | 67.1 | pass@1 | https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard |
| Massive Multitask Language Understanding | 84.2 | 5-shot | https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard |
| MMLU PRO | 64.4 | — | https://huggingface.co/spaces/TIGER-Lab/MMLU-Pro |
Migration checks
No linked migration route is available for this model yet.