Using Claude 3.5 Haiku on GCP Vertex AI

Implementation guide · Claude 3.5 · Anthropic

Serverless

GCP Vertex AI exposes Claude 3.5 Haiku through model ID claude-3.5-haiku. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-07-26. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at GCP Vertex AI and generate an API key.
  2. 2
    Use the GCP Vertex AI SDK or REST API to call claude-3.5-haiku — see the documentation for request format.
  3. 3
    You'll be billed $0.80/1M input, $4.00/1M output tokens. See full pricing.

Code Examples

Install
pip install google-cloud-aiplatform
API key
GOOGLE_CLOUD_PROJECT
Model ID
claude-3.5-haiku

For Google-published models use the model name directly, e.g. "gemini-2.0-flash-001". For third-party publishers (Anthropic, Meta, etc.) use the full publisher path, e.g. "publishers/anthropic/models/claude-3-5-sonnet-v2@20241022".

import os
import vertexai
from vertexai.generative_models import GenerativeModel

# Reads GOOGLE_CLOUD_PROJECT from env; authenticates via Application Default Credentials
vertexai.init(project=os.environ["GOOGLE_CLOUD_PROJECT"], location="us-central1")
model = GenerativeModel("claude-3.5-haiku")
response = model.generate_content("Hello")
print(response.text)

Pricing on GCP Vertex AI

TypePrice (per 1M)
Input tokens$0.80
Output tokens$4.00

Capabilities

VisionReasoningStructured OutputsCode Execution

About Claude 3.5 Haiku

Claude 3.5 Haiku is Anthropic's latest AI model, known for its speed and efficiency while maintaining high intelligence. It is optimized for applications needing rapid response, like interactive chatbots and real-time content moderation. Initially text-only, future plans include image input capabilities. It excels in delivering fast, accurate code suggestions, processing and categorizing information swiftly, and handling large volumes of user interactions. Priced accessibly, it offers advanced coding, tool use, and reasoning abilities. Though initially surpassing Claude 3 Haiku in benchmarks, its pricing reflects its enhanced performance 123457.

Model Specs

Released2024-10-22
Context200k
ArchitectureDecoder Only

Provider

GCP Vertex AI

Google Cloud Platform (GCP)

Mountain View, California, United States