Last refreshed 2026-04-24. Next refresh: weekly.
Why use CodeLlama 34B on DeepInfra?
DeepInfra offers CodeLlama 34B with pay-as-you-go pricing at $0.20/1M input tokens. DeepInfra is a cloud inference platform offering cost-effective access to open-source AI models.
Compare CodeLlama 34B across 6 providers to find the best fit for your use caseSetup recipe
Python + curlpip install openaiexport DEEPINFRA_API_KEY=...import os
from openai import OpenAI
client = OpenAI(
api_key=os.environ["DEEPINFRA_API_KEY"],codellama-34bRequest example
import os
from openai import OpenAI
client = OpenAI(
api_key=os.environ["DEEPINFRA_API_KEY"],
base_url="https://api.deepinfra.com/v1/openai"
)
response = client.chat.completions.create(
model="codellama-34b",
messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)Gotchas
- DeepInfra uses "organization/model-name" format, e.g. "meta-llama/Meta-Llama-3-8B-Instruct" or "mistralai/Mistral-7B-Instruct-v0.3". See the DeepInfra model catalog for exact IDs.
- The examples expect DEEPINFRA_API_KEY; rename it only if your application config maps the new variable.
Compare CodeLlama 34B Across Providers
| Provider | Input (per 1M) | Output (per 1M) |
|---|---|---|
| Together AI | $0.80 | $0.80 |
| DeepInfra | $0.20 | $0.45 |
| Fireworks AI | $0.90 | $0.90 |
| IBM watsonx | $1.80 | $1.80 |
| Microsoft Foundry | $1.54 | $1.77 |
Pricing
| Type | Price (per 1M) |
|---|---|
| Input tokens | $0.20 |
| Output tokens | $0.45 |
Capabilities
About CodeLlama 34B
CodeLlama 34B is a powerful generative text model developed by Meta, specifically tailored for code synthesis and understanding. With 34 billion parameters, it excels in code completion, infilling, and instruction following, particularly for Python programming. The model utilizes an auto-regressive transformer architecture and has been trained on a diverse dataset of programming languages, making it versatile for various coding tasks. Designed for both commercial and research applications, CodeLlama 34B offers AI engineers a robust tool for integrating advanced code generation capabilities into their projects. More details can be found on the model's Hugging Face page .
FAQ
What does CodeLlama 34B cost on DeepInfra?
On DeepInfra, CodeLlama 34B costs $0.20 per 1M input tokens and $0.45 per 1M output tokens.
What is the context window for CodeLlama 34B on DeepInfra?
CodeLlama 34B supports a 100,000 token context window on DeepInfra.
How does DeepInfra compare to other CodeLlama 34B providers?
CodeLlama 34B is available from 6 providers. The cheapest input pricing is $0.20/1M tokens from DeepInfra.
Who created CodeLlama 34B?
CodeLlama 34B was created by AI at Meta as part of the Code Llama model family.
Is CodeLlama 34B open source?
CodeLlama 34B is open source according to the seed data.