Last refreshed 2026-04-15. Next refresh: weekly.
Why use Llama 2 70B on Fireworks AI?
Fireworks AI offers Llama 2 70B with pay-as-you-go pricing at $0.90/1M input tokens. Fireworks AI offers a generative AI platform as a service, focusing on rapid product iteration and cost-efficient AI deployment.
Setup recipe
Python + curlpip install openaiexport FIREWORKS_API_KEY=...import os
from openai import OpenAI
client = OpenAI(
api_key=os.environ["FIREWORKS_API_KEY"],llama2-70bRequest example
import os
from openai import OpenAI
client = OpenAI(
api_key=os.environ["FIREWORKS_API_KEY"],
base_url="https://api.fireworks.ai/inference/v1"
)
response = client.chat.completions.create(
model="llama2-70b",
messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)Gotchas
- Fireworks model IDs use "accounts/fireworks/models/{model-name}" format, e.g. "accounts/fireworks/models/llama4-scout-instruct-basic" or "accounts/fireworks/models/deepseek-r1".
- The examples expect FIREWORKS_API_KEY; rename it only if your application config maps the new variable.
Pricing
| Type | Price (per 1M) |
|---|---|
| Input tokens | $0.90 |
| Output tokens | $0.90 |
Capabilities
No model capability flags are currently sourced.
About Llama 2 70B
Llama 2 70B is a state-of-the-art generative text model developed by Meta, featuring 70 billion parameters and optimized for dialogue applications. It utilizes an advanced transformer architecture and has been fine-tuned using supervised learning and RLHF. Pretrained on 2 trillion tokens from diverse public sources, it outperforms many open-source chat models and competes with popular closed-source models in terms of helpfulness and safety. The model is designed for commercial and research applications in English, focusing on assistant-like chat functionalities. It accepts text input and generates text output, making it suitable for various natural language processing tasks .
FAQ
What does Llama 2 70B cost on Fireworks AI?
On Fireworks AI, Llama 2 70B costs $0.9 per 1M input tokens and $0.9 per 1M output tokens.
What is the context window for Llama 2 70B on Fireworks AI?
Llama 2 70B supports a 4,000 token context window on Fireworks AI.
Who created Llama 2 70B?
Llama 2 70B was created by AI at Meta as part of the Llama 2 model family.
Is Llama 2 70B open source?
Llama 2 70B is open source according to the seed data.