OpenHermes 7B
OpenHermes 7B is released 2023-07-18 in the OpenHermes family with open-source; evaluate it while provider pricing coverage matures.
- Family
- OpenHermes
- Released
- 2023-07-18
- Context
- 32K
- Parameters
- 7B
- Architecture
- Decoder Only
- Specialization
- general
- Openness
- Open source
- License
- Apache 2.0OSI-approvedPermitted
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
No tracked provider pricing is available yet.
About
OpenHermes 7B is a notable large language model in natural language processing, recognized for fine-tuning on an open-source dataset and employing sample packing to expedite training. It is built on the Llama-2-7b-hf base and trained with around 242,000 entries, including GPT-4-generated content from open AI community datasets. It excludes certain private datasets, focusing on comprehensive sources like GPTeacher and WizardLM. The model's capabilities are evidenced by mixed performance on benchmarks like GPT-4All, BigBench, and TruthfulQA, indicating variable strengths across tasks. While not yet applicable for serverless API deployment, it supports dedicated Inference Endpoints 1.
Providers
No active provider routes are tracked for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.