Orca 13B
Orca 13B is released 2023-06-05 in the Orca family with open-weight; evaluate it while provider pricing coverage matures.
- Family
- Orca
- Released
- 2023-06-05
- Context
- 2K
- Parameters
- 13B
- Architecture
- Decoder Only
- Specialization
- general
- Openness
- Open weights
- License
- Microsoft ResearchCommercial use: non-commercial
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
Advancing the state-of-the-art in AI and computing.
No tracked provider pricing is available yet.
About
Orca 13B, a powerful AI language model developed by Microsoft, leverages a fine-tuned LLaMA-2 base model architecture to mimic the reasoning processes of larger models like GPT-4. Although significantly smaller than GPT-4, it requires fewer computational resources and aims for comparable performance. The model enhances reasoning abilities using a synthetic training dataset moderated by Microsoft Azure content filters. Its capabilities include reasoning, reading comprehension, math problem-solving, and text summarization, though it's not optimized for chat tasks. Orca 13B employs a progressive learning approach, learning from GPT-4's explanation traces to improve accuracy and contextual understanding.
Providers
No active provider routes are tracked for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
Advancing the state-of-the-art in AI and computing.
No tracked provider pricing is available yet.