Pangu Models by Huawei Noah's Ark Lab
Last refreshed 2026-05-19. Next refresh: weekly.
Details
About
The Pangu large language model (LLM) family, developed by Huawei, comprises advanced models tailored for various natural language processing tasks. Launched in 2021 as pioneering pre-trained Chinese LLMs with over 100 billion parameters 7, Pangu models have seen remarkable evolution. Pangu-α, featuring 200 billion parameters, was adeptly trained on 2048 Ascend processors through a hybrid parallel training technique 3. The series also includes Pangu-π, which enhances model performance with architectural innovations for increased nonlinearity and expressive power 2, and is utilized in specialized applications such as the YunShan model for finance and law 2. Notably, Pangu-Σ, with a trillion parameters, utilizes a sparse heterogeneous computing architecture 8, while Pangu 3.0 targets industry-specific needs with a comprehensive three-layer structure 5. This LLM family exemplifies Huawei's dedication to producing robust, efficient models for varied uses, though details of training and parameter specifications might differ across sources.
Decision facts
- Best fit
- coding
- Capability starting point
- Pangu 3.0 10B with 128k context
- Lowest tracked input
- Not tracked
- Closest related family
- PixArt
Current Variants
Use-when guidance is based on each model's tracked capabilities, context window, release date, and replacement status.
Use when the workload needs 128k context and 10B parameters.
| Model | Use when | Released | Signals | Status |
|---|---|---|---|---|
| Pangu 3.0 100B | Use when the workload needs 100B parameters. | 2024-04 | 100B parameters | Current |
| Pangu 3.0 71B | Use when the workload needs 71B parameters. | 2024-04 | 71B parameters | Current |
| Pangu 3.0 38B | Use when the workload needs 38B parameters. | 2024-04 | 38B parameters | Current |
| Pangu 3.0 10B | Use when the workload needs 128k context and 10B parameters. | 2024-04 | 128k context10B parameters | Current |
Release Timeline
1 release groupSpecifications(4 models)
| Model | Released | Context | Parameters |
|---|---|---|---|
| Pangu 3.0 100B | 2024-04 | — | 100B |
| Pangu 3.0 71B | 2024-04 | — | 71B |
| Pangu 3.0 38B | 2024-04 | — | 38B |
| Pangu 3.0 10B | 2024-04 | 128k | 10B |
