LLM ReferenceLLM Reference
DeepInfra

DeepInfra CodeLlama 70B Instruct on DeepInfra

Code Llama · AI at Meta

ServerlessOpen Source

Last refreshed 2026-04-24. Next refresh: weekly.

Why use DeepInfra CodeLlama 70B Instruct on DeepInfra?

DeepInfra offers DeepInfra CodeLlama 70B Instruct with pay-as-you-go pricing at $0.45/1M input tokens. DeepInfra is a cloud inference platform offering cost-effective access to open-source AI models.

Input / 1M
$0.45
Output / 1M
$0.65
Cache
Not sourced
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install openai
Auth
export DEEPINFRA_API_KEY=...
Call
import os
from openai import OpenAI
client = OpenAI(
    api_key=os.environ["DEEPINFRA_API_KEY"],
Model ID
deepinfra-codellama-70b-instruct

Request example

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["DEEPINFRA_API_KEY"],
    base_url="https://api.deepinfra.com/v1/openai"
)
response = client.chat.completions.create(
    model="deepinfra-codellama-70b-instruct",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Gotchas

  • DeepInfra uses "organization/model-name" format, e.g. "meta-llama/Meta-Llama-3-8B-Instruct" or "mistralai/Mistral-7B-Instruct-v0.3". See the DeepInfra model catalog for exact IDs.
  • The examples expect DEEPINFRA_API_KEY; rename it only if your application config maps the new variable.

Pricing

TypePrice (per 1M)
Input tokens$0.45
Output tokens$0.65

Capabilities

Structured Outputs

About DeepInfra CodeLlama 70B Instruct

CodeLlama 70B Instruct via DeepInfra

FAQ

What does DeepInfra CodeLlama 70B Instruct cost on DeepInfra?

On DeepInfra, DeepInfra CodeLlama 70B Instruct costs $0.45 per 1M input tokens and $0.65 per 1M output tokens.

What is the context window for DeepInfra CodeLlama 70B Instruct on DeepInfra?

DeepInfra CodeLlama 70B Instruct supports a 100,000 token context window on DeepInfra.

Who created DeepInfra CodeLlama 70B Instruct?

DeepInfra CodeLlama 70B Instruct was created by AI at Meta as part of the Code Llama model family.

Is DeepInfra CodeLlama 70B Instruct open source?

DeepInfra CodeLlama 70B Instruct is open source according to the seed data.

Get Started

Model Specs

Released2023-07-18
Parameters70B
Context100k
ArchitectureDecoder Only

Related Models on DeepInfra