Using Llama 3.1 8B Instruct on Novita AI

Quick Start

1. 1
   Create an account at Novita AI and generate an API key.
2. 2
   Use the Novita AI SDK or REST API to call llama-3.1-8b-instruct.
3. 3
   You'll be billed $0.02/1M input, $0.05/1M output tokens. See full pricing.

Code Examples

About Novita AI

Novita AI offers a GPU-based inference API for image, video, and language model generation with a broad catalog of open-source models.

Pricing on Novita AI

Capabilities

About Llama 3.1 8B Instruct

The Llama 3.1 8B Instruct model, released on July 23, 2024, is a multilingual large language model with 8 billion parameters, optimized for instruction-following tasks. It features an enhanced transformer architecture, supporting languages like English, German, French, and others. The model excels in dialogue applications, having been fine-tuned using supervised fine-tuning and reinforcement learning with human feedback. Trained on approximately 15 trillion tokens with a December 2023 data cutoff, it outperforms many existing open-source and closed chat models in various benchmarks. Ideal for commercial and research applications such as conversational agents and content generation, the model can be accessed on Hugging Face .