Orca
About
The Orca family of large language models (LLMs), developed by Microsoft, emphasizes enhancing reasoning capabilities in smaller models. The original Orca model showcased impressive reasoning by emulating the step-by-step processes of more advanced LLMs 2. Orca 2, the latest version, builds upon this foundation, outperforming similar-sized models and rivaling the performance of much larger models on complex reasoning tasks 23. Both models are available for research, with Orca 2 particularly noted for its diverse reasoning techniques and adaptability to different tasks, demonstrating the potential of strategic training to enhance the capabilities of smaller LLMs 2.