SOLAR 0 70B
SOLAR 0 70B is released 2023-10-26 in the Solar 0 family with open-source; evaluate it while provider pricing coverage matures.
Use it for
- Teams evaluating general LLM work
- Workloads that can use a 4k context window
Do not use it for
- Cost-sensitive launches that need sourced token pricing
- Vision or document-understanding workloads
- Strict JSON or tool-calling flows
- Family
- Solar 0
- Released
- 2023-10-26
- Context
- 4k
- Parameters
- 70B
- Architecture
- Decoder Only
- Specialization
- general
- Openness
- Open source
- License
- Apache 2.0OSI-approvedCommercial use: permitted
- Training
- Fine-tuned
No tracked provider token pricing is available yet.
About
SOLAR-0-70b, developed by Upstage, is an advanced LLM derived from Llama 2, possessing 70 billion parameters and enhanced for processing lengthy sequences over 10,000 tokens using a rope_scaling option. It implements a transformer architecture and is trained on diverse datasets like Orca-style and Alpaca-style, excelling in benchmarks such as ARC-Challenge, HellaSwag, MMLU, and TruthfulQA with high H4 scores. Despite its prowess, it faces limitations, including potential biases and significant computational demands, which may impact accessibility. Various quantized versions, including an 8-bit variant, aim to enhance efficiency, and the model is accessible on platforms like Poe, also offering an API for broader application.
SOLAR 0 70B is an open-source model in the Solar 0 family. The structured metadata tracks a 4k-token context window. No headline benchmark score is tracked for SOLAR 0 70B yet.
Top use-case fit
No primary decision-task fit is mapped for this model yet.
Provider price ladder
No tracked provider token pricing is available for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
Frequently asked questions
What is the context window of SOLAR 0 70B?
SOLAR 0 70B has a context window of 4k tokens.
When was SOLAR 0 70B released?
SOLAR 0 70B was released on 2023-10-26.