Using Llama 3 70B Instruct on OctoAI API (Deprecated)
Implementation guide · Llama 3 · AI at Meta
Quick Start
- 1Create an account at OctoAI API (Deprecated) and generate an API key.
- 2Use the OctoAI API (Deprecated) SDK or REST API to call
llama3-70b-instruct.
Code Examples
About OctoAI API (Deprecated)
No public independent OctoAI API, model catalog, portal, documentation, or pricing surface was verified on the former OctoAI routes checked. Those routes redirect to NVIDIA’s general site; do not treat that site as a successor to the former OctoAI API.
OctoAI was a hosted inference platform for running third-party foundation models. OctoAI’s company profile states that NVIDIA acquired it in September 2024 and that it was dissolved as an independent corporate entity. This entry is retained only as historical provider coverage.
Pricing on OctoAI API (Deprecated)
Capabilities
About Llama 3 70B Instruct
The Llama 3 70B Instruct model is a large language model with 70 billion parameters, released by Meta on April 18, 2024. It's an instruction-tuned variant optimized for conversational applications, utilizing an advanced auto-regressive transformer architecture. The model excels in following instructions and engaging in dialogue, having been trained on over 15 trillion tokens with a December 2023 knowledge cutoff. It demonstrates superior performance on industry benchmarks, scoring 82.0 on the MMLU (5-shot) test. The model incorporates extensive safety measures and optimizations, including RLHF, to enhance helpfulness and reduce harmful content generation. For more details, visit the model's Hugging Face page [1].