Solar 0 Models by Upstage

About

The "Solar 0" family of large language models (LLMs), created by Upstage AI, utilize the Llama 2 architecture and are recognized for their exceptional benchmark performance, often surpassing larger models. A distinguishing feature of these models is the implementation of depth up-scaling (DUS), which enhances performance efficiently without the added complexity of mixture-of-experts techniques. This family includes models with various parameter counts and quantization levels, like the 70B parameters available in both 8-bit and 16-bit versions. Notably, the SOLAR-0-70b-16bit model earned a top spot on the HuggingFace Open LLM leaderboard. Primarily geared towards text generation tasks, these models are capable of instruction following and dialogue, and though they focus on English, their adaptability through fine-tuning opens the door for multilingual applications.

Specifications(2 models)

Available From(1 provider)

Pricing

Related Model Families

Solar Decide

Solar Mini

Solar Pro

Models(2)