Using Llama 3.3 70B Instruct on Fireworks AI

Quick Start

1. 1
   Create an account at Fireworks AI and generate an API key.
2. 2
   Use the Fireworks AI SDK or REST API to call accounts/fireworks/models/llama-v3p3-70b-instruct — see the documentation for request format.
3. 3
   You'll be billed $0.90/1M input, $0.90/1M output tokens. See full pricing.

Code Examples

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["FIREWORKS_API_KEY"],
    base_url="https://api.fireworks.ai/inference/v1"
)
response = client.chat.completions.create(
    model="accounts/fireworks/models/llama-v3p3-70b-instruct",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Pricing on Fireworks AI

Capabilities

About Llama 3.3 70B Instruct

Llama 3.3 70B Instruct is Meta's text-only, instruction-tuned 70B Llama 3.3 model for multilingual assistant-style chat, with a 128K-token context window and openly downloadable weights.