LLM Reference
DeepInfra

DeepInfra CodeLlama 70B Instruct on DeepInfra

Code Llama · AI at Meta

ServerlessOpen Weights

Last refreshed 2026-06-15. Next refresh: weekly.

Why use DeepInfra CodeLlama 70B Instruct on DeepInfra?

DeepInfra offers DeepInfra CodeLlama 70B Instruct with pay-as-you-go pricing at $0.45/1M input tokens. DeepInfra is a cloud inference platform offering cost-effective access to open-source AI models.

Input / 1M
$0.45
Output / 1M
$0.65
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install openai
Auth
export DEEPINFRA_API_KEY=...
Call
import os
from openai import OpenAI
client = OpenAI(
    api_key=os.environ["DEEPINFRA_API_KEY"],
Model ID
deepinfra-codellama-70b-instruct

Request example

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["DEEPINFRA_API_KEY"],
    base_url="https://api.deepinfra.com/v1/openai"
)
response = client.chat.completions.create(
    model="deepinfra-codellama-70b-instruct",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Gotchas

  • DeepInfra uses "organization/model-name" format, e.g. "meta-llama/Meta-Llama-3-8B-Instruct" or "mistralai/Mistral-7B-Instruct-v0.3". See the DeepInfra model catalog for exact IDs.
  • The examples expect DEEPINFRA_API_KEY; rename it only if your application config maps the new variable.

Pricing

TypePrice (per 1M)
Input tokens$0.45
Output tokens$0.65

Capabilities

Structured Outputs

About DeepInfra CodeLlama 70B Instruct

DeepInfra CodeLlama 70B Instruct is Meta's Code Llama model. It offers a 100K-token context window with weights openly available for self-hosting.

FAQ

What does DeepInfra CodeLlama 70B Instruct cost on DeepInfra?

On DeepInfra, DeepInfra CodeLlama 70B Instruct costs $0.45 per 1M input tokens and $0.65 per 1M output tokens.

What is the context window for DeepInfra CodeLlama 70B Instruct on DeepInfra?

DeepInfra CodeLlama 70B Instruct supports a 100k token context window on DeepInfra.

Who created DeepInfra CodeLlama 70B Instruct?

DeepInfra CodeLlama 70B Instruct was created by AI at Meta as part of the Code Llama model family.

Is DeepInfra CodeLlama 70B Instruct open source?

DeepInfra CodeLlama 70B Instruct has open weights under Llama 2 Community according to the seed data, but that does not necessarily mean an OSI-approved open-source license.

Get Started

Model Specs

Released2023-07-18
Parameters70B
Context100k
ArchitectureDecoder Only
Knowledge cutoff2022-09

Related Models on DeepInfra