LLM Reference

Using Llama 3.2 3B Instruct on Novita AI

Implementation guide · Llama 3.2 · AI at Meta

ServerlessOpen Source

Quick Start

  1. 1
    Create an account at Novita AI and generate an API key.
  2. 2
    Use the Novita AI SDK or REST API to call llama-3.2-3b-instruct.
  3. 3
    You'll be billed $0.03/1M input, $0.05/1M output tokens. See full pricing.
API PortalPricingModel Card

Code Examples

Code examples for this provider have not been sourced yet.

About Novita AI

Novita AI offers a GPU-based inference API for image, video, and language model generation with a broad catalog of open-source models.

View all models on Novita AI →

Pricing on Novita AI

TypePrice (per 1M)
Input tokens$0.03
Output tokens$0.05

Capabilities

Structured Outputs

About Llama 3.2 3B Instruct

Llama 3.2 3B Instruct is Meta's Llama 3.2 model. It offers a 128K-token context window with weights openly available for self-hosting and scores 34.7 on MMLU PRO.

Full model details →

Model Specs

Released2024-09-25
Parameters3.21B
Context128K
ArchitectureDecoder Only
Knowledge cutoff2023-12

Also available on(5)

OpenRouter$0.05/1MFireworks AI$0.10/1MAWS Bedrock$0.15/1M
Compare all providers →

Provider

Novita AI