LLM ReferenceLLM Reference
Fireworks AI

CodeLlama 70B Instruct on Fireworks AI

Code Llama · AI at Meta

ServerlessOpen Source

Last refreshed 2026-04-15. Next refresh: weekly.

Why use CodeLlama 70B Instruct on Fireworks AI?

Fireworks AI offers CodeLlama 70B Instruct with pay-as-you-go pricing at $0.90/1M input tokens. Fireworks AI offers a generative AI platform as a service, focusing on rapid product iteration and cost-efficient AI deployment.

Input / 1M
$0.90
Output / 1M
$0.90
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install openai
Auth
export FIREWORKS_API_KEY=...
Call
import os
from openai import OpenAI
client = OpenAI(
    api_key=os.environ["FIREWORKS_API_KEY"],
Model ID
codellama-70b-instruct

Request example

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["FIREWORKS_API_KEY"],
    base_url="https://api.fireworks.ai/inference/v1"
)
response = client.chat.completions.create(
    model="codellama-70b-instruct",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Gotchas

  • Fireworks model IDs use "accounts/fireworks/models/{model-name}" format, e.g. "accounts/fireworks/models/llama4-scout-instruct-basic" or "accounts/fireworks/models/deepseek-r1".
  • The examples expect FIREWORKS_API_KEY; rename it only if your application config maps the new variable.

Pricing

TypePrice (per 1M)
Input tokens$0.90
Output tokens$0.90

Capabilities

No model capability flags are currently sourced.

About CodeLlama 70B Instruct

CodeLlama 70B Instruct is a large-scale generative text model with 70 billion parameters, specifically designed for code synthesis and understanding tasks. Fine-tuned to follow user instructions effectively, it excels in interactive coding environments, supporting tasks such as code completion, infilling, and explanation. The model is optimized for efficient processing and is suitable for both commercial and research applications in English and various programming languages. While it offers advanced capabilities for AI-assisted coding, it's important to note that it doesn't support long contexts of up to 100k tokens, which may limit its use with extensive codebases. For more details, refer to the model's Hugging Face page .

FAQ

What does CodeLlama 70B Instruct cost on Fireworks AI?

On Fireworks AI, CodeLlama 70B Instruct costs $0.9 per 1M input tokens and $0.9 per 1M output tokens.

What is the context window for CodeLlama 70B Instruct on Fireworks AI?

CodeLlama 70B Instruct supports a 16,000 token context window on Fireworks AI.

Who created CodeLlama 70B Instruct?

CodeLlama 70B Instruct was created by AI at Meta as part of the Code Llama model family.

Is CodeLlama 70B Instruct open source?

CodeLlama 70B Instruct is open source according to the seed data.

Get Started

Model Specs

Released2024-01-29
Parameters70B
Context16K
ArchitectureDecoder Only