LLM Reference

Using OctoML Nous-Hermes-2-Mixtral-8x7B-DPO on OctoML (Deprecated)

Implementation guide · Hermes 2 · Nous Research

ServerlessOpen Source

Quick Start

  1. 1
    Create an account at OctoML (Deprecated) and generate an API key.
  2. 2
    Use the OctoML (Deprecated) SDK or REST API to call octoml-nous-hermes-2-mixtral-8x7b-dpo — see the documentation for request format.
  3. 3
    You'll be billed $0.40/1M input, $0.60/1M output tokens. See full pricing.
API PortalDocumentationPricing

Code Examples

See OctoML (Deprecated) documentation for integration details.

About OctoML (Deprecated)

Optimized inference platform for foundation models

OctoML is an optimized inference platform for foundation models, offering serverless and dedicated deployment with performance tuning for production AI workloads.

View all models on OctoML (Deprecated) →

Pricing on OctoML (Deprecated)

TypePrice (per 1M)
Input tokens$0.40
Output tokens$0.60

Capabilities

No model capability flags are currently sourced.

About OctoML Nous-Hermes-2-Mixtral-8x7B-DPO

OctoML Nous-Hermes-2-Mixtral-8x7B-DPO is Nous Research's Hermes 2 model. It offers a 32K-token context window with weights openly available for self-hosting.

Full model details →

Model Specs

Released2023-12-10
Parameters56B
Context33K
ArchitectureDecoder Only
Knowledge cutoff2023-12

Provider

OctoML (Deprecated)

OctoML

Seattle, Washington, United States