Solar 0
About
The "Solar 0" family of large language models (LLMs), created by Upstage AI, utilize the Llama 2 architecture and are recognized for their exceptional benchmark performance, often surpassing larger models. A distinguishing feature of these models is the implementation of depth up-scaling (DUS), which enhances performance efficiently without the added complexity of mixture-of-experts techniques. This family includes models with various parameter counts and quantization levels, like the 70B parameters available in both 8-bit and 16-bit versions. Notably, the SOLAR-0-70b-16bit model earned a top spot on the HuggingFace Open LLM leaderboard. Primarily geared towards text generation tasks, these models are capable of instruction following and dialogue, and though they focus on English, their adaptability through fine-tuning opens the door for multilingual applications.
Specifications(1 models)
| Model | Released | Parameters |
|---|---|---|
| SOLAR 0 70B | 2023-10 | 70B |
Frequently Asked Questions
- What is Solar 0?
- The "Solar 0" family of large language models (LLMs), created by Upstage AI, utilize the Llama 2 architecture and are recognized for their exceptional benchmark performance, often surpassing larger models. A distinguishing feature of these models is the implementation of depth up-scaling (DUS), which enhances performance efficiently without the added complexity of mixture-of-experts techniques. This family includes models with various parameter counts and quantization levels, like the 70B parameters available in both 8-bit and 16-bit versions. Notably, the SOLAR-0-70b-16bit model earned a top spot on the HuggingFace Open LLM leaderboard. Primarily geared towards text generation tasks, these models are capable of instruction following and dialogue, and though they focus on English, their adaptability through fine-tuning opens the door for multilingual applications.
- How many models are in the Solar 0 family?
- The Solar 0 family contains 1 model.
- What is the latest Solar 0 model?
- The latest model is SOLAR 0 70B, released in 2023-10.
