OpenHermes 13B
OpenHermes 13B is released 2023-07-18 in the OpenHermes family with open-source; evaluate it while provider pricing coverage matures.
- Family
- OpenHermes
- Released
- 2023-07-18
- Context
- 4K
- Parameters
- 13B
- Architecture
- Decoder Only
- Specialization
- general
- Openness
- Open source
- License
- Apache 2.0OSI-approvedPermitted
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
No tracked provider pricing is available yet.
About
OpenHermes-13B is a large language model (LLM) fine-tuned by Teknium on a dataset primarily containing GPT-4-generated data. Built on the Llama-2-13b-hf base model, it comprises 13 billion parameters and is trained on an open-source dataset with 242,000 entries. The training data includes contributions from sources like GPTeacher, WizardLM, and Airoboros GPT-4. Key features include filtering OpenAI refusals and a context length of 4096 tokens. While demonstrating strong text generation capabilities, especially in benchmarks like GPT4All, it shows limitations in reasoning and logic, as seen in the AGIEval score. Training details are accessible through WandB, highlighting its transparent development process.
Providers
No active provider routes are tracked for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.