Using Llama 3 70B Instruct on OctoAI API (Deprecated)

Implementation guide · Llama 3 · AI at Meta

Open Weights

OctoAI API (Deprecated) exposes Llama 3 70B Instruct through model ID llama3-70b-instruct. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-07-11. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at OctoAI API (Deprecated) and generate an API key.
  2. 2
    Use the OctoAI API (Deprecated) SDK or REST API to call llama3-70b-instruct.

Code Examples

Code examples for this provider have not been sourced yet.

Pricing on OctoAI API (Deprecated)

Capabilities

Structured Outputs

About Llama 3 70B Instruct

The Llama 3 70B Instruct model is a large language model with 70 billion parameters, released by Meta on April 18, 2024. It's an instruction-tuned variant optimized for conversational applications, utilizing an advanced auto-regressive transformer architecture. The model excels in following instructions and engaging in dialogue, having been trained on over 15 trillion tokens with a December 2023 knowledge cutoff. It demonstrates superior performance on industry benchmarks, scoring 82.0 on the MMLU (5-shot) test. The model incorporates extensive safety measures and optimizations, including RLHF, to enhance helpfulness and reduce harmful content generation.

Full model details →

Model Specs

Released2024-04-18
Parameters70B
Context8k
ArchitectureDecoder Only
Knowledge cutoff2023-12

More Models on OctoAI API (Deprecated)

Llama 3 8B Instruct
All models on OctoAI API (Deprecated) →

Also available on(17)

Hyperbolic AI Inference$0.40/1MDeepInfra$0.45/1MOpenRouter$0.51/1M
Compare all providers →

Provider

OctoAI API (Deprecated)

OctoAI (acquired by NVIDIA)

Seattle, Washington, United States