LLM Reference

Using Hermes 2 Pro Llama 3 8B on Novita AI

Implementation guide · Hermes 2 · Nous Research

Serverless

Quick Start

  1. 1
    Create an account at Novita AI and generate an API key.
  2. 2
    Use the Novita AI SDK or REST API to call hermes-2-pro-llama-3-8b.
  3. 3
    You'll be billed $0.14/1M input, $0.14/1M output tokens. See full pricing.

Code Examples

Code examples for this provider have not been sourced yet.

About Novita AI

Novita AI offers a GPU-based inference API for image, video, and language model generation with a broad catalog of open-source models.

Pricing on Novita AI

TypePrice (per 1M)
Input tokens$0.14
Output tokens$0.14

Capabilities

No model capability flags are currently sourced.

About Hermes 2 Pro Llama 3 8B

8B Hermes model merging Hermes 2 Pro with Llama 3 architecture for superior function calling and structured outputs. Excels in ChatML format multi-turn conversations.

Model Specs

Released2023-12-12
Parameters8B
Context8K
ArchitectureDecoder Only
Knowledge cutoff2023-12

Provider

Novita AI