Using Nous Hermes Llama 2 13B on Fireworks AI

Implementation guide · Hermes · Nous Research

ProvisionedOpen Source

Fireworks AI exposes Nous Hermes Llama 2 13B through model ID accounts/fireworks/models/nous-hermes-llama2-13b. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-04-19. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at Fireworks AI and generate an API key.
  2. 2
    Use the Fireworks AI SDK or REST API to call accounts/fireworks/models/nous-hermes-llama2-13b — see the documentation for request format.
  3. 3
    You'll be billed $0.20/1M input, $0.20/1M output tokens. See full pricing.

Code Examples

Install
pip install openai
API key
FIREWORKS_API_KEY
Model ID
accounts/fireworks/models/nous-hermes-llama2-13b

Fireworks model IDs use "accounts/fireworks/models/{model-name}" format, e.g. "accounts/fireworks/models/llama4-scout-instruct-basic" or "accounts/fireworks/models/deepseek-r1".

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["FIREWORKS_API_KEY"],
    base_url="https://api.fireworks.ai/inference/v1"
)
response = client.chat.completions.create(
    model="accounts/fireworks/models/nous-hermes-llama2-13b",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Pricing on Fireworks AI

TypePrice (per 1M)
Input tokens$0.20
Output tokens$0.20

Capabilities

Structured Outputs

About Nous Hermes Llama 2 13B

The Nous Hermes Llama 2 13B is an advanced large language model fine-tuned on over 300,000 instructions, building upon the Llama 2 architecture. Developed by Nous Research with contributions from Teknium, Emozilla, and compute sponsorship from Redmond AI, the model boasts features like extended response generation, reduced hallucinations, and compatibility with Alpaca prompt format. It is trained on a diverse dataset, including synthetic GPT-4 outputs, enhancing its knowledge and task completion capabilities.

Model Specs

Released2023-12-15
Parameters13B
ArchitectureDecoder Only
Knowledge cutoff2022-09

Provider

Fireworks AI

San Mateo, California, United States