LLM Reference
OctoAI API (Deprecated)

Using Llama Guard 2 8B on OctoAI API (Deprecated)

Implementation guide · Llama Guard · AI at Meta

Open Weights

Quick Start

  1. 1
    Create an account at OctoAI API (Deprecated) and generate an API key.
  2. 2
    Use the OctoAI API (Deprecated) SDK or REST API to call llama-guard-2-8b.

Code Examples

Code examples for this provider have not been sourced yet.

About OctoAI API (Deprecated)

No public independent OctoAI API, model catalog, portal, documentation, or pricing surface was verified on the former OctoAI routes checked. Those routes redirect to NVIDIA’s general site; do not treat that site as a successor to the former OctoAI API.

OctoAI was a hosted inference platform for running third-party foundation models. OctoAI’s company profile states that NVIDIA acquired it in September 2024 and that it was dissolved as an independent corporate entity. This entry is retained only as historical provider coverage.

Pricing on OctoAI API (Deprecated)

Capabilities

No model capability flags are currently sourced.

About Llama Guard 2 8B

Llama Guard 2 is an 8B-parameter LLM built on the Llama 3 architecture, specifically designed for content moderation tasks. Released by Meta on April 18, 2024, it excels in classifying both inputs and outputs of LLMs across 11 safety categories. The model generates text outputs indicating whether content is safe or unsafe, providing detailed feedback on violations. It aims to enhance user experience by minimizing false positives while maintaining high accuracy in content moderation, supporting developers in creating safer AI applications .

Model Specs

Released2024-04-18
Parameters8B
Context8k
ArchitectureDecoder Only
Knowledge cutoff2023-03

Provider

OctoAI API (Deprecated)
OctoAI API (Deprecated)

OctoAI (acquired by NVIDIA)

Seattle, Washington, United States