Using GPT-3.5 Turbo (Instruct) on Vercel AI Gateway
Implementation guide · GPT-3.5 · OpenAI
Quick Start
- 1
- 2Use the Vercel AI Gateway SDK or REST API to call
openai/gpt-3.5-turbo-instruct— see the documentation for request format. - 3
Code Examples
pip install openaiAI_GATEWAY_API_KEYopenai/gpt-3.5-turbo-instructcreator/model-name e.g. kwaipilot/kat-coder-pro-v2
import os
from openai import OpenAI
client = OpenAI(
api_key=os.environ["AI_GATEWAY_API_KEY"],
base_url="https://ai-gateway.vercel.sh/v1"
)
response = client.chat.completions.create(
model="openai/gpt-3.5-turbo-instruct",
messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)About Vercel AI Gateway
Vercel AI Gateway is a unified AI proxy providing a single OpenAI-compatible API endpoint to 275+ models from 25+ providers including Anthropic, OpenAI, Google, Meta, Mistral, DeepSeek, xAI, Alibaba, Amazon, ByteDance, Cohere, MiniMax, MoonshotAI, KwaiPilot, Black Forest Labs, Recraft, Voyage AI, NVIDIA, and more. Pricing is pass-through at provider list rates with zero markup. Includes $5/month free tier; paid is pay-as-you-go. Features: automatic provider fallbacks, unified observability, streaming, tool use, vision, embeddings, image/video generation, BYOK mode. Integrates via @ai-sdk/gateway package or plain model ID strings in Vercel AI SDK. API details: API key via Authorization: Bearer <AI_GATEWAY_API_KEY>. Key from Vercel dashboard. Free $5/month credit; paid tier is provider list price with zero markup. BYOK (bring-your-own-key) also supported with no markup or fee. Model IDs use {provider-owner}/{model-name} — e.g., anthropic/claude-opus-4.6, openai/gpt-5.
Vercel AI Gateway is a unified AI proxy providing a single OpenAI-compatible API endpoint to 275+ models from 25+ providers including Anthropic, OpenAI, Google, Meta, Mistral, DeepSeek, xAI, Alibaba, Amazon, ByteDance, Cohere, MiniMax, MoonshotAI, KwaiPilot, Black Forest Labs, Recraft, Voyage AI, NVIDIA, and more. Pricing is pass-through at provider list rates with zero markup. Includes $5/month free tier; paid is pay-as-you-go. Features: automatic provider fallbacks, unified observability, streaming, tool use, vision, embeddings, image/video generation, BYOK mode. Integrates via @ai-sdk/gateway package or plain model ID strings in Vercel AI SDK.
Pricing on Vercel AI Gateway
| Type | Price (per 1M) |
|---|---|
| Input tokens | $1.50 |
| Output tokens | $2.00 |
Capabilities
About GPT-3.5 Turbo (Instruct)
GPT-3.5 Turbo Instruct by OpenAI is designed to excel in precise instruction following and task completion, focusing on accuracy and clarity over conversational abilities. It offers key enhancements like efficient instruction adherence, reduced hallucination, and lower toxicity compared to previous models. Compatible with legacy completion endpoints, it retains the speed and affordability of the standard GPT-3.5 Turbo model while using a 4K context window and training data up to September 2021. Not specifically built for chat, it still supports diverse tasks like question answering, text completion, and code generation, aiming to enhance AI usability with safer and more accurate interactions.