OpenHermes 2.5 Mistral 7B
OpenHermes 2.5 Mistral 7B is worth evaluating for coding and classification when its provider route and context window match the workload.
Use it for
- Teams evaluating coding and classification
- Workloads that can use a 32k context window
- Buyers comparing 2 tracked provider routes
Do not use it for
- Vision or document-understanding workloads
- Strict JSON or tool-calling flows
- Family
- OpenHermes 2
- Released
- 2023-12-15
- Context
- 32k
- Parameters
- 7B
- Architecture
- Decoder Only
- Knowledge cutoff
- 2023-12
- Specialization
- general
- Training
- finetuned
Cheapest of 2 routes · Fireworks AI
About
OpenHermes 2.5 Mistral 7B is an advanced large language model developed by Teknium, building on the previous version, OpenHermes 2. Utilizing a transformer architecture, it's fine-tuned on over one million entries, combining code and non-code data, primarily composed of GPT-4 generated text. This enhances its human-like response capabilities across diverse contexts. It excels in conversational AI with its multi-turn dialogue support through the ChatML format, significantly improves in code generation tasks with a high HumanEval score, and performs robustly on benchmarks like GPT4All and AGIEval. Additionally, it offers various quantization options for optimized hardware performance and is adept at real-time data processing, making it ideal for customer service and immediate data analysis applications.
OpenHermes 2.5 Mistral 7B is a model in the OpenHermes 2 family. The structured metadata tracks a 32k-token context window. This page tracks provider routes through Together AI and Fireworks AI, with the cheapest tracked route listed at $0.2 input and $0.2 output per 1M tokens. Headline tracked benchmarks include Google-Proof Q&A 38.6, HellaSwag 86.0, and HumanEval 54.8.
Top use-case fit: coding, agents, and build tasks
Coding
Q/$ B1 relevant benchmark in the decision map.
Classification
Q/$ B2 relevant benchmarks in the decision map.
Provider price ladder
Compare all 2Compare API pricing across 2 providers for input and output tokens, batch, and cached reads when available.
| Provider | Input / 1M | Output / 1M | Route |
|---|---|---|---|
| Fireworks AI | $0.200 | $0.200 | Provisioned |
| Together AI | $0.200 | $0.200 | Serverless |
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
Benchmark scores(4)
| Benchmark | Score | Version | Source |
|---|---|---|---|
| Google-Proof Q&A | 38.6 | diamond | https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard |
| HellaSwag | 86.0 | 10-shot | https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard |
| HumanEval | 54.8 | pass@1 | https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard |
| Massive Multitask Language Understanding | 63.5 | 5-shot | https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard |
Migration checks
No linked migration route is available for this model yet.