OpenHermes Models by Teknium
About
The OpenHermes family of large language models (LLMs) are built upon the Mistral foundation model, renowned for their stellar performance on benchmarks involving reasoning, instruction adherence, and providing truthful outputs 458. Fine-tuned on a substantial dataset with contributions from GPT-4 generated content and other high-quality open-source data, these models leverage ChatML for superior multi-turn conversation handling 4511. They offer various quantized versions, balancing resource needs and performance 238. OpenHermes models are recognized for their human-like text generation and strong instruction following, although they can be verbose 11. The OpenHermes-2.5-Mistral-7B model stands out for significant improvements and competitive edge over other Mistral adaptations 45.
Current Variants
Use-when guidance is derived from seed capabilities, context, release, and replacement fields.
Use when the workload needs 4k context and 13B parameters.
Use when the workload needs 32k context and 7B parameters.
| Model | Use when | Released | Signals | Status |
|---|---|---|---|---|
| OpenHermes 13B | Use when the workload needs 4k context and 13B parameters. | 2023-07 | 4k context13B parameters | Current |
| OpenHermes 7B | Use when the workload needs 32k context and 7B parameters. | 2023-07 | 32k context7B parameters | Current |
Release Timeline
1 release groupSpecifications(2 models)
| Model | Released | Context | Parameters |
|---|---|---|---|
| OpenHermes 13B | 2023-07 | 4k | 13B |
| OpenHermes 7B | 2023-07 | 32k | 7B |
Frequently Asked Questions
- What is OpenHermes used for?
- The OpenHermes family of large language models (LLMs) are built upon the Mistral foundation model, renowned for their stellar performance on benchmarks involving reasoning, instruction adherence, and providing truthful outputs 458.
- How does OpenHermes compare to MOSS-Audio?
- OpenHermes by Teknium is strongest where you need its listed use cases, while MOSS-Audio by MOSI Intelligence is the closest related family to check for multimodal. OpenHermes has 2 listed variants and reaches up to 32k context, so compare the specs and pricing tables before choosing a production model.
- Which OpenHermes model should I use?
- If price is the main constraint, use the pricing table first because OpenHermes does not have complete provider pricing in the local data. For the most capable/latest local choice, evaluate OpenHermes 7B with 32k context.




