Baichuan 2
About
Baichuan 2 is a family of advanced multilingual language models developed by Baichuan Intelligent Technology, featuring models with 7 billion and 13 billion parameters. These models are available as both base and chat versions, optimized for instruction following. Trained from scratch on an impressive dataset comprising 2.6 trillion tokens, Baichuan 2 models offer robust performance across various benchmarks, excelling in mathematics, code generation, and multilingual tasks. The open-source nature of these models allows for both research and commercial applications, subject to licensing agreements. For efficient inference, a 4-bit quantized version of the chat models is provided, and Baichuan has released intermediate training checkpoints to support research on large language model training dynamics 1258.
Specifications(5 models)
| Model | Released | Context | Parameters |
|---|---|---|---|
| Baichuan 2 Chat | 2023-10 | 4K | — |
| Baichuan 2 13B | 2023-06 | 4K | 13B |
| Baichuan 2 7B | 2023-06 | 4K | 7B |
| Baichuan 2 13B Chat | 2023-06 | — | 13B |
| Baichuan 2 7B Chat | 2023-06 | — | 7B |
Available From(2 providers)
Frequently Asked Questions
- What is Baichuan 2?
- Baichuan 2 is a family of advanced multilingual language models developed by Baichuan Intelligent Technology, featuring models with 7 billion and 13 billion parameters. These models are available as both base and chat versions, optimized for instruction following. Trained from scratch on an impressive dataset comprising 2.6 trillion tokens, Baichuan 2 models offer robust performance across various benchmarks, excelling in mathematics, code generation, and multilingual tasks. The open-source nature of these models allows for both research and commercial applications, subject to licensing agreements. For efficient inference, a 4-bit quantized version of the chat models is provided, and Baichuan has released intermediate training checkpoints to support research on large language model training dynamics 1258.
- How many models are in the Baichuan 2 family?
- The Baichuan 2 family contains 5 models.
- What is the latest Baichuan 2 model?
- The latest model is Baichuan 2 Chat, released in 2023-10.
