Using GPT-3.5 Turbo on Replicate API

Implementation guide · GPT-3.5 · OpenAI

Serverless

Replicate API exposes GPT-3.5 Turbo through model ID gpt-3.5-turbo. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-05-10. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at Replicate API and generate an API key.
  2. 2
    Use the Replicate API SDK or REST API to call gpt-3.5-turbo — see the documentation for request format.
  3. 3
    You'll be billed $0.50/1M input, $1.50/1M output tokens. See full pricing.

Code Examples

Install
pip install replicate
API key
REPLICATE_API_TOKEN
Model ID
gpt-3.5-turbo

Replicate uses "owner/model-name" format (e.g. "meta/meta-llama-3-8b-instruct") for the latest version, or "owner/model-name:version-sha" to pin to a specific version. The REST endpoint splits owner and model-name into the path: /v1/models/{owner}/{model-name}/predictions.

import replicate

# reads REPLICATE_API_TOKEN from env
# gpt-3.5-turbo format: "owner/model-name" (latest version) or "owner/model-name:version-hash"
output = replicate.run(
    "gpt-3.5-turbo",
    input={"prompt": "Hello"}
)
# Output is a list or generator depending on the model
print("".join(output))

Pricing on Replicate API

TypePrice (per 1M)
Input tokens$0.50
Output tokens$1.50

Capabilities

Structured Outputs

About GPT-3.5 Turbo

GPT-3.5 Turbo is an advanced language model developed by OpenAI, showcasing significant advancements over GPT-3 and GPT-3.5. As the engine behind the popular ChatGPT application, it excels in tasks like text generation, translation, question answering, summarization, and code generation. This model employs Reinforcement Learning from Human Feedback (RLHF) to enhance accuracy and produce policy-optimized responses. Despite its prowess, it has a knowledge cutoff of September 2021 and can demonstrate biases from its training data. Occasionally, it may generate incorrect or nonsensical content, known as "hallucination," and is sensitive to input phrasing variations.

Model Specs

Released2023-03-01
Parameters20B
Context16k
ArchitectureDecoder Only
Knowledge cutoff2021-09

Provider

Replicate API

Replicate

San Francisco, California, United States