Using Nous Hermes Llama 2 13B on Replicate API
Implementation guide · Hermes · Nous Research
Replicate API exposes Nous Hermes Llama 2 13B through model ID nous-hermes-llama2-13b. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.
Last refreshed 2026-04-19. Next refresh: weekly.
Quick Start
- 1
- 2Use the Replicate API SDK or REST API to call
nous-hermes-llama2-13b— see the documentation for request format. - 3
Code Examples
pip install replicateREPLICATE_API_TOKENnous-hermes-llama2-13bReplicate uses "owner/model-name" format (e.g. "meta/meta-llama-3-8b-instruct") for the latest version, or "owner/model-name:version-sha" to pin to a specific version. The REST endpoint splits owner and model-name into the path: /v1/models/{owner}/{model-name}/predictions.
import replicate
# reads REPLICATE_API_TOKEN from env
# nous-hermes-llama2-13b format: "owner/model-name" (latest version) or "owner/model-name:version-hash"
output = replicate.run(
"nous-hermes-llama2-13b",
input={"prompt": "Hello"}
)
# Output is a list or generator depending on the model
print("".join(output))Pricing on Replicate API
| Type | Price (per 1M) |
|---|---|
| Input tokens | $0.10 |
| Output tokens | $0.50 |
Capabilities
About Nous Hermes Llama 2 13B
The Nous Hermes Llama 2 13B is an advanced large language model fine-tuned on over 300,000 instructions, building upon the Llama 2 architecture. Developed by Nous Research with contributions from Teknium, Emozilla, and compute sponsorship from Redmond AI, the model boasts features like extended response generation, reduced hallucinations, and compatibility with Alpaca prompt format. It is trained on a diverse dataset, including synthetic GPT-4 outputs, enhancing its knowledge and task completion capabilities.