Orca 2
About
Orca 2 is a family of small language models (SLMs) created by Microsoft Research, specifically engineered to enhance reasoning capabilities in smaller frameworks. Unlike large language models (LLMs) that heavily focus on size, Orca 2 demonstrates that smaller models can achieve performance comparable to or even exceeding larger models through innovative techniques. These models utilize instruction tuning, explanation tuning, and a unique method that omits conventional system prompts for more strategic reasoning. They are available in 7 billion and 13 billion parameter versions, both fine-tuned from LLaMA 2 base models with high-quality synthetic data. Orca 2 excels in reading comprehension, math problem-solving, and text summarization while being openly accessible for research. Despite its robust abilities, it still encompasses limitations such as potential biases and risks of generating inaccurate content 148.
Specifications(2 models)
| Model | Released | Parameters |
|---|---|---|
| Orca 2 13B | 2023-11 | 13B |
| Orca 2 7B | 2023-11 | 7B |
Available From(1 provider)
Pricing
| Model | Provider | Input / 1M | Output / 1M | Type |
|---|---|---|---|---|
| Orca 2 7B | Microsoft Foundry | $0.52 | $0.67 | Provisioned |
| Orca 2 13B | Microsoft Foundry | $0.81 | $0.94 | Provisioned |
Frequently Asked Questions
- What is Orca 2?
- Orca 2 is a family of small language models (SLMs) created by Microsoft Research, specifically engineered to enhance reasoning capabilities in smaller frameworks. Unlike large language models (LLMs) that heavily focus on size, Orca 2 demonstrates that smaller models can achieve performance comparable to or even exceeding larger models through innovative techniques. These models utilize instruction tuning, explanation tuning, and a unique method that omits conventional system prompts for more strategic reasoning. They are available in 7 billion and 13 billion parameter versions, both fine-tuned from LLaMA 2 base models with high-quality synthetic data. Orca 2 excels in reading comprehension, math problem-solving, and text summarization while being openly accessible for research. Despite its robust abilities, it still encompasses limitations such as potential biases and risks of generating inaccurate content 148.
- How many models are in the Orca 2 family?
- The Orca 2 family contains 2 models.
- What is the latest Orca 2 model?
- The latest model is Orca 2 13B, released in 2023-11.
- How much does Orca 2 cost?
- Orca 2 models range from $0.52/1M to $0.81/1M input tokens depending on the model and provider.
