Using Nous Hermes Llama 2 13B on Together AI

Quick Start

1. 1
   Create an account at Together AI and generate an API key.
2. 2
   Use the Together AI SDK or REST API to call nous-hermes-llama2-13b — see the documentation for request format.
3. 3
   You'll be billed $0.30/1M input, $0.30/1M output tokens. See full pricing.

Code Examples

from together import Together

client = Together()  # reads TOGETHER_API_KEY from env
response = client.chat.completions.create(
    model="nous-hermes-llama2-13b",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

About Together AI

Platform for running open-source and proprietary LLMs

Together AI is a platform for running open-source and proprietary LLMs with fast serverless and dedicated endpoints at competitive inference pricing.

Pricing on Together AI

Capabilities

About Nous Hermes Llama 2 13B

The Nous Hermes Llama 2 13B is an advanced large language model fine-tuned on over 300,000 instructions, building upon the Llama 2 architecture. Developed by Nous Research with contributions from Teknium, Emozilla, and compute sponsorship from Redmond AI, the model boasts features like extended response generation, reduced hallucinations, and compatibility with Alpaca prompt format. It is trained on a diverse dataset, including synthetic GPT-4 outputs, enhancing its knowledge and task completion capabilities. Known for strong performance across various benchmarks, it is suitable for applications like chatbots, content generation, and code generation, while still acknowledging limitations such as data bias and handling of open-ended prompts.