Using LLaMA 7B on Replicate API

Implementation guide · LLaMA · AI at Meta

ServerlessOpen Weights

Replicate API exposes LLaMA 7B through model ID replicate/llama-7b. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-09-29. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at Replicate API and generate an API key.
  2. 2
    Use the Replicate API SDK or REST API to call replicate/llama-7b — see the documentation for request format.

Code Examples

Install
pip install replicate
API key
REPLICATE_API_TOKEN
Model ID
replicate/llama-7b

Replicate uses "owner/model-name" format (e.g. "meta/meta-llama-3-8b-instruct") for the latest version, or "owner/model-name:version-sha" to pin to a specific version. The REST endpoint splits owner and model-name into the path: /v1/models/{owner}/{model-name}/predictions.

import replicate

# reads REPLICATE_API_TOKEN from env
# replicate/llama-7b format: "owner/model-name" (latest version) or "owner/model-name:version-hash"
output = replicate.run(
    "replicate/llama-7b",
    input={"prompt": "Hello"}
)
# Output is a list or generator depending on the model
print("".join(output))

Pricing on Replicate API

Capabilities

No model capability flags are currently sourced.

About LLaMA 7B

Meta's original LLaMA (Large Language Model Meta AI) 7B parameter model. Released February 2023, it demonstrated that smaller models trained on more data could match larger models. Foundation for the LLaMA family of open models.

Model Specs

Released2023-02-24
Parameters7B
Context2k
ArchitectureDecoder Only

Provider

Replicate API

Replicate

San Francisco, California, United States