Using CodeLlama 34B Python on Replicate API

Implementation guide · Code Llama · AI at Meta

ServerlessOpen Weights

Replicate API exposes CodeLlama 34B Python through model ID codellama-34b-python. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-07-09. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at Replicate API and generate an API key.
  2. 2
    Use the Replicate API SDK or REST API to call codellama-34b-python — see the documentation for request format.
  3. 3
    You'll be billed $0.20/1M input, $1.00/1M output tokens. See full pricing.

Code Examples

Install
pip install replicate
API key
REPLICATE_API_TOKEN
Model ID
codellama-34b-python

Replicate uses "owner/model-name" format (e.g. "meta/meta-llama-3-8b-instruct") for the latest version, or "owner/model-name:version-sha" to pin to a specific version. The REST endpoint splits owner and model-name into the path: /v1/models/{owner}/{model-name}/predictions.

import replicate

# reads REPLICATE_API_TOKEN from env
# codellama-34b-python format: "owner/model-name" (latest version) or "owner/model-name:version-hash"
output = replicate.run(
    "codellama-34b-python",
    input={"prompt": "Hello"}
)
# Output is a list or generator depending on the model
print("".join(output))

Pricing on Replicate API

TypePrice (per 1M)
Input tokens$0.20
Output tokens$1.00

Capabilities

Structured Outputs

About CodeLlama 34B Python

CodeLlama 34B Python is a specialized code generation model released by Meta on August 24, 2023. With 34 billion parameters, it excels in Python-specific tasks like code completion, infilling, and instruction following. This model offers AI engineers a powerful tool for enhancing coding workflows and productivity. Its architecture is optimized for understanding and generating complex code structures, making it particularly useful for software development tasks. The model is available in the Hugging Face Transformers format, facilitating easy integration into existing projects .

Model Specs

Released2023-08-24
Parameters34B
Context100k
ArchitectureDecoder Only
Knowledge cutoff2024-03

Provider

Replicate API

Replicate

San Francisco, California, United States