OpenOrca
About
The OpenOrca family of large language models (LLMs) leverages the Mistral 7B base model, fine-tuned with the OpenOrca dataset. This comprehensive dataset, mirroring the Orca Research Paper dataset, includes approximately 1 million GPT-4 completions and 3.2 million GPT-3.5 completions. OpenOrca models excel in a range of natural language processing tasks such as text and code generation, question answering, and conversations. Among these, the Mistral-7B-OpenOrca stands out for its superior performance among models with less than 30 billion parameters, achieving 98% of Llama2-70B-chat's performance on the HuggingFace leaderboard at its release. Designed to run efficiently on consumer-grade GPUs, these models are valuable tools for developers, though users should be mindful of potential biases inherent to the LLMs' training data1246810.
Specifications(10 models)
| Model | Released | Context | Parameters |
|---|---|---|---|
| Mixtral 8x7B SlimOrca | 2023-12 | 32K | 56B |
| Mistral 7B SlimOrca | 2023-10 | 8K | 7B |
| Mistral 7B OpenOrca | 2023-10 | 8K | 7B |
| Mistral 7B OpenOrca Platypus | 2023-10 | 8K | 7B |
| OpenOrca Phi 1.5 | 2023-09 | 4K | 1.5B |
| LlongOrca 13B 16K | 2023-08 | 16K | 13B |
| OpenOrca Platypus2 13B | 2023-08 | 4K | 13B |
| LlongOrca 7B 16K | 2023-08 | 16K | 7B |
| OpenOrca x OpenChat 13B | 2023-07 | 4K | 13B |
| OpenOrca 13B | 2023-07 | 4K | 13B |
Available From(2 providers)
Pricing
| Model | Provider | Input / 1M | Output / 1M | Type |
|---|---|---|---|---|
| Mistral 7B OpenOrca | Together AI | $0.2 | $0.2 | Serverless |
| Mistral 7B OpenOrca | Fireworks AI | $0.2 | $0.2 | Provisioned |
Frequently Asked Questions
- What is OpenOrca?
- The OpenOrca family of large language models (LLMs) leverages the Mistral 7B base model, fine-tuned with the OpenOrca dataset. This comprehensive dataset, mirroring the Orca Research Paper dataset, includes approximately 1 million GPT-4 completions and 3.2 million GPT-3.5 completions. OpenOrca models excel in a range of natural language processing tasks such as text and code generation, question answering, and conversations. Among these, the Mistral-7B-OpenOrca stands out for its superior performance among models with less than 30 billion parameters, achieving 98% of Llama2-70B-chat's performance on the HuggingFace leaderboard at its release. Designed to run efficiently on consumer-grade GPUs, these models are valuable tools for developers, though users should be mindful of potential biases inherent to the LLMs' training data1246810.
- How many models are in the OpenOrca family?
- The OpenOrca family contains 10 models.
- What is the latest OpenOrca model?
- The latest model is Mixtral 8x7B SlimOrca, released in 2023-12.
- How much does OpenOrca cost?
- OpenOrca models are available at $0.2/1M input tokens through providers like Together AI.
Related Model Families
Models(10)
Mixtral 8x7B SlimOrca
Mistral 7B SlimOrca
Mistral 7B OpenOrca
Mistral 7B OpenOrca Platypus
OpenOrca Phi 1.5
LlongOrca 13B 16K
OpenOrca Platypus2 13B
LlongOrca 7B 16K
OpenOrca x OpenChat 13B
OpenOrca 13B