SOLAR 0 70B
SOLAR 0 70B is released 2023-10-26 in the Solar 0 family with open-source; evaluate it while provider pricing coverage matures.
- Family
- Solar 0
- Released
- 2023-10-26
- Context
- 4k
- Parameters
- 70B
- Architecture
- Decoder Only
- Specialization
- general
- Openness
- Open source
- License
- Apache 2.0OSI-approvedCommercial use: permitted
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
No tracked provider token pricing is available yet.
About
SOLAR-0-70b, developed by Upstage, is an advanced LLM derived from Llama 2, possessing 70 billion parameters and enhanced for processing lengthy sequences over 10,000 tokens using a rope_scaling option. It implements a transformer architecture and is trained on diverse datasets like Orca-style and Alpaca-style, excelling in benchmarks such as ARC-Challenge, HellaSwag, MMLU, and TruthfulQA with high H4 scores. Despite its prowess, it faces limitations, including potential biases and significant computational demands, which may impact accessibility.
Provider price ladder
No tracked provider token pricing is available for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.