Orca Models by Microsoft Research
Last refreshed 2026-09-02. Next refresh: weekly.
Details
About
The Orca family of large language models (LLMs), developed by Microsoft, emphasizes enhancing reasoning capabilities in smaller models. The original Orca model showcased impressive reasoning by emulating the step-by-step processes of more advanced LLMs 2. Orca 2, the latest version, builds upon this foundation, outperforming similar-sized models and rivaling the performance of much larger models on complex reasoning tasks 23. Both models are available for research, with Orca 2 particularly noted for its diverse reasoning techniques and adaptability to different tasks, demonstrating the potential of strategic training to enhance the capabilities of smaller LLMs 2.
Decision facts
Current Variants
Use-when guidance is based on each model's tracked capabilities, context window, release date, and replacement status.
Use when the workload needs 2k context and 13B parameters.
| Model | Use when | Released | Signals | Status |
|---|---|---|---|---|
| Orca 13B | Use when the workload needs 2k context and 13B parameters. | 2023-06 | 2k context13B parameters | Current |
Release Timeline
1 release groupSpecifications(1 models)
| Model | Released | Context | Parameters |
|---|---|---|---|
| Orca 13B | 2023-06 | 2k | 13B |
