Using Claude 3.5 Sonnet on AWS Bedrock

Quick Start

1. 1
   Create an account at AWS Bedrock and generate an API key.
2. 2
   Use the AWS Bedrock SDK or REST API to call claude-3.5-sonnet — see the documentation for request format.
3. 3
   You'll be billed $3.00/1M input, $15.00/1M output tokens. See full pricing.

Code Examples

import boto3

# Reads AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY, AWS_DEFAULT_REGION from env
client = boto3.client("bedrock-runtime", region_name="us-east-1")
response = client.converse(
    modelId="claude-3.5-sonnet",
    messages=[{
        "role": "user",
        "content": [{"text": "Hello"}]
    }]
)
print(response["output"]["message"]["content"][0]["text"])

About AWS Bedrock

Amazon Bedrock is a comprehensive, fully managed service for building and scaling generative AI applications. The platform provides access to a diverse array of high-performing foundation models (FMs) from leading AI companies through a unified API, enabling users to select the most suitable models for their specific use cases. Key features include model customization using proprietary data through techniques like fine-tuning and Retrieval Augmented Generation (RAG), which significantly enhances the relevance and accuracy of AI outputs. Additionally, the platform supports the automation of complex tasks with agents capable of executing multi-step operations, making it versatile for applications ranging from text generation and image creation to conversational AI. Beyond its robust technical capabilities, Amazon Bedrock offers a serverless experience that streamlines infrastructure management, allowing developers to focus on application development without the burden of managing underlying resources. The platform prioritizes security and compliance, ensuring that data remains within the AWS ecosystem and adheres to industry standards. Bedrock's flexible pricing models, including pay-as-you-go options, enable organizations to effectively manage costs while scaling their AI initiatives. This combination of advanced features, ease of use, and cost-effectiveness positions Amazon Bedrock as a powerful tool for businesses looking to innovate rapidly in the generative AI space, ultimately enhancing productivity and operational efficiency.

AWS Bedrock is Amazon's fully managed foundation-model service, providing unified API access to top models from Anthropic, Meta, Mistral, and other leading AI labs with built-in tools for RAG, fine-tuning, and AI agent development.

Pricing on AWS Bedrock

Capabilities

About Claude 3.5 Sonnet

Claude 3.5 Sonnet, the latest in Anthropic's line of large language models, merges state-of-the-art reasoning, coding, and natural language understanding capabilities with advanced multi-modal processing. Released in October 2024, it excels in benchmarks against previous models and competitors, thanks to its scalable attention mechanisms and massive neural network architecture. Its dynamic routing enables specialization in various tasks, supporting applications from software development and data analysis to customer support and content creation. Users benefit from its "Artifacts" feature for real-time collaborative workflows and can access the model through platforms like Claude.ai and APIs at competitive pricing rates.