Qwen-72B

Released
2023-11-30
Last refreshed
2026-10-07
Status
Researched 151d ago
Open weightsCommercial use: restricted
Alibaba releases · 51 in the last 12 monthsChangelog →
Specifications
Family
Qwen
Released
2023-11-30
Context
32K
Parameters
72B
Architecture
Decoder Only
Specialization
general
Openness
Open weights
License
QianwenRestricted
Weights
Unknown
Code
Unknown
Training
Fine-tuned
Created by

AI research institute of Alibaba Group.

Hangzhou, Zhejiang, China
Founded 2017
Website
Pricing
Output / 1M
$0.900
Input / 1M
$0.900

Cheapest of 1 route · Fireworks AI

About

The Qwen-72B is a potent large language model developed by Alibaba Cloud, featuring 72 billion parameters and built on the Transformer architecture. This model introduces enhancements such as SwiGLU activation, attention QKV bias, and group query attention for efficient performance on complex language tasks. Trained on a dataset of over 3 trillion tokens, it excels in multiple domains, including language understanding and generation, code generation, and translation, across multiple languages like Chinese and English. With an impressive context length of up to 32,000 tokens and a vocabulary exceeding 150,000 tokens, it manages extensive text inputs well.

Providers(1)

Compare API pricing across 1 tracked provider route for input and output tokens, batch, and cached reads when available.

ProviderInput / 1MOutput / 1MRoute
Fireworks AI$0.900$0.900
Provisioned

Available via routers & gateways(1)

Capabilities

No model capability flags are currently sourced.

Benchmark peer barsfor Coding

No task-mapped benchmark peers are available for this model yet.

Migration checks

No linked migration route is available for this model yet.