Orca 2 Models by Microsoft Research
Last refreshed 2026-05-19. Next refresh: weekly.
Details
About
Orca 2 is a family of small language models (SLMs) created by Microsoft Research, specifically engineered to enhance reasoning capabilities in smaller frameworks. Unlike large language models (LLMs) that heavily focus on size, Orca 2 demonstrates that smaller models can achieve performance comparable to or even exceeding larger models through innovative techniques. These models utilize instruction tuning, explanation tuning, and a unique method that omits conventional system prompts for more strategic reasoning. They are available in 7 billion and 13 billion parameter versions, both fine-tuned from LLaMA 2 base models with high-quality synthetic data. Orca 2 excels in reading comprehension, math problem-solving, and text summarization while being openly accessible for research. Despite its robust abilities, it still encompasses limitations such as potential biases and risks of generating inaccurate content 148.
Decision facts
- Best fit
- math-heavy prompts
- Capability starting point
- Orca 2 13B with 4k context
- Lowest tracked input
- Orca 2 7B · $0.52/1M · Microsoft Foundry
- Closest related family
- Harrier
Current Variants
Use-when guidance is based on each model's tracked capabilities, context window, release date, and replacement status.
Use when the workload needs 4k context and 13B parameters.
Use when the workload needs 4k context and 7B parameters.
| Model | Use when | Released | Signals | Status |
|---|---|---|---|---|
| Orca 2 13B | Use when the workload needs 4k context and 13B parameters. | 2023-11 | 4k context13B parameters | Current |
| Orca 2 7B | Use when the workload needs 4k context and 7B parameters. | 2023-11 | 4k context7B parameters | Current |
Release Timeline
1 release groupSpecifications(2 models)
| Model | Released | Context | Parameters |
|---|---|---|---|
| Orca 2 13B | 2023-11 | 4k | 13B |
| Orca 2 7B | 2023-11 | 4k | 7B |
Available From(1 provider)
Pricing
| Model | Provider | Input / 1M | Output / 1M | Type |
|---|---|---|---|---|
| Orca 2 7B | Microsoft Foundry | $0.52 | $0.67 | Provisioned |
| Orca 2 13B | Microsoft Foundry | $0.81 | $0.94 | Provisioned |
