Using Llama 3 8B Instruct on OctoAI API (Deprecated)
Implementation guide · Llama 3 · AI at Meta
Quick Start
- 1Create an account at OctoAI API (Deprecated) and generate an API key.
- 2Use the OctoAI API (Deprecated) SDK or REST API to call
llama3-8b-instruct.
Code Examples
About OctoAI API (Deprecated)
No public independent OctoAI API, model catalog, portal, documentation, or pricing surface was verified on the former OctoAI routes checked. Those routes redirect to NVIDIA’s general site; do not treat that site as a successor to the former OctoAI API.
OctoAI was a hosted inference platform for running third-party foundation models. OctoAI’s company profile states that NVIDIA acquired it in September 2024 and that it was dissolved as an independent corporate entity. This entry is retained only as historical provider coverage.
Pricing on OctoAI API (Deprecated)
Capabilities
About Llama 3 8B Instruct
The Llama 3 8B Instruct model, released on April 18, 2024, is Meta's latest instruction-following language model with 8 billion parameters. It utilizes an auto-regressive transformer architecture with Grouped-Query Attention for improved scalability. Trained on over 15 trillion tokens and fine-tuned with 10 million human-annotated examples, it excels in dialogue and conversational tasks. The model outperforms its predecessors on industry benchmarks, scoring 68.4 on MMLU (5-shot). Designed for commercial and research applications, it prioritizes safety and helpfulness, making it suitable for chatbots, virtual assistants, and other interactive AI applications. For more details, visit the Hugging Face page [1].