Solar 0 Models by Upstage
About
The "Solar 0" family of large language models (LLMs), created by Upstage AI, utilize the Llama 2 architecture and are recognized for their exceptional benchmark performance, often surpassing larger models. A distinguishing feature of these models is the implementation of depth up-scaling (DUS), which enhances performance efficiently without the added complexity of mixture-of-experts techniques. This family includes models with various parameter counts and quantization levels, like the 70B parameters available in both 8-bit and 16-bit versions. Notably, the SOLAR-0-70b-16bit model earned a top spot on the HuggingFace Open LLM leaderboard. Primarily geared towards text generation tasks, these models are capable of instruction following and dialogue, and though they focus on English, their adaptability through fine-tuning opens the door for multilingual applications.
Current Variants
Use-when guidance is derived from seed capabilities, context, release, and replacement fields.
Use when the workload needs 4K context and 10.7B parameters.
| Model | Use when | Released | Signals | Status |
|---|---|---|---|---|
| Fireworks Solar-10.7B-Instruct-v1.0 | Use when the workload needs 4K context and 10.7B parameters. | 2024-05 | 4K context10.7B parameters | Current |
| SOLAR 0 70B | Use when the workload needs 70B parameters. | 2023-10 | 70B parameters | Current |
Release Timeline
2 release groupsSpecifications(2 models)
| Model | Released | Context | Parameters |
|---|---|---|---|
| Fireworks Solar-10.7B-Instruct-v1.0 | 2024-05 | 4K | 10.7B |
| SOLAR 0 70B | 2023-10 | — | 70B |
Available From(1 provider)
Pricing
| Model | Provider | Input / 1M | Output / 1M | Type |
|---|---|---|---|---|
| Fireworks Solar-10.7B-Instruct-v1.0 | Fireworks AI | $0.15 | $0.15 | Serverless |
Frequently Asked Questions
- What is Solar 0 used for?
- The "Solar 0" family of large language models (LLMs), created by Upstage AI, utilize the Llama 2 architecture and are recognized for their exceptional benchmark performance, often surpassing larger models.
- How does Solar 0 compare to Solar Mini?
- Solar 0 by Upstage is strongest where you need its listed use cases, while Solar Mini by Upstage is the closest related family to check for structured outputs. Solar 0 has 2 listed variants and reaches up to 4K context, so compare the specs and pricing tables before choosing a production model.
- Which Solar 0 model should I use?
- For the lowest listed input price, start with Fireworks Solar-10.7B-Instruct-v1.0 through Fireworks AI at $0.15/1M input tokens. For the most capable/latest local choice, evaluate Fireworks Solar-10.7B-Instruct-v1.0 with 4K context.
