Using GPT-3.5 Turbo (Instruct) on Vercel AI Gateway

Implementation guide · GPT-3.5 · OpenAI

Serverless

Vercel AI Gateway exposes GPT-3.5 Turbo (Instruct) through model ID openai/gpt-3.5-turbo-instruct. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-06-29. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at Vercel AI Gateway and generate an API key.
  2. 2
    Use the Vercel AI Gateway SDK or REST API to call openai/gpt-3.5-turbo-instruct — see the documentation for request format.
  3. 3
    You'll be billed $1.50/1M input, $2.00/1M output tokens. See full pricing.

Code Examples

Install
pip install openai
API key
AI_GATEWAY_API_KEY
Model ID
openai/gpt-3.5-turbo-instruct

creator/model-name e.g. kwaipilot/kat-coder-pro-v2

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["AI_GATEWAY_API_KEY"],
    base_url="https://ai-gateway.vercel.sh/v1"
)
response = client.chat.completions.create(
    model="openai/gpt-3.5-turbo-instruct",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Pricing on Vercel AI Gateway

TypePrice (per 1M)
Input tokens$1.50
Output tokens$2.00

Capabilities

Structured Outputs

About GPT-3.5 Turbo (Instruct)

GPT-3.5 Turbo Instruct by OpenAI is designed to excel in precise instruction following and task completion, focusing on accuracy and clarity over conversational abilities. It offers key enhancements like efficient instruction adherence, reduced hallucination, and lower toxicity compared to previous models. Compatible with legacy completion endpoints, it retains the speed and affordability of the standard GPT-3.5 Turbo model while using a 4K context window and training data up to September 2021. Not specifically built for chat, it still supports diverse tasks like question answering, text completion, and code generation, aiming to enhance AI usability with safer and more accurate interactions.

Model Specs

Released2023-09-19
Parameters20B
Context4k
ArchitectureDecoder Only
Knowledge cutoff2021-09

More Models on Vercel AI Gateway

Provider

Vercel AI Gateway

Vercel