LLM Reference

Claude 3.5 Sonnet

Released
2024-06-20
Last refreshed
2026-05-16
Status
Researched 46d ago
MultimodalCodingRAGAgentsLong contextVisionClassificationJSON / Tool use

Claude 3.5 Sonnet is worth evaluating for coding, rag, and agents when its provider route and context window match the workload.

Use it for

  • Teams evaluating coding, rag, and agents
  • Workloads that can use a 200k context window
  • Buyers comparing 4 tracked provider routes

Do not use it for

  • Workloads where another current model has stronger sourced task evidence
Specifications
Released
2024-06-20
Context
200k
Parameters
70B
Architecture
Decoder Only
Knowledge cutoff
2024-04
Specialization
general
Training
finetuned
Created by

Developing safe and ethical AI systems.

San Francisco, California, United States
Founded 2021
Website
Pricing
Output / 1M
$15.00
Input / 1M
$3.00

Cheapest of 6 routes · Anthropic · cache read $0.300

About

Claude 3.5 Sonnet, the latest in Anthropic's line of large language models, merges state-of-the-art reasoning, coding, and natural language understanding capabilities with advanced multi-modal processing. Released in October 2024, it excels in benchmarks against previous models and competitors, thanks to its scalable attention mechanisms and massive neural network architecture. Its dynamic routing enables specialization in various tasks, supporting applications from software development and data analysis to customer support and content creation. Users benefit from its "Artifacts" feature for real-time collaborative workflows and can access the model through platforms like Claude.ai and APIs at competitive pricing rates.

Claude 3.5 Sonnet is a model in the Claude 3.5 family. The structured metadata tracks a 200k-token context window, multimodal input, reasoning, function calling, structured outputs, and code execution. This page tracks provider routes through GCP Vertex AI, AWS Bedrock, Anthropic, and 3 more, with the cheapest tracked route listed at $3 input and $15 output per 1M tokens. Headline tracked benchmarks include HellaSwag 96.2, HumanEval 92.0, and Massive Multitask Language Understanding 88.7.

Top use-case fit: coding, agents, and build tasks

Coding

Q/$ D

5 relevant benchmarks in the decision map.

RAG

Included by capability and metadata signals in the decision map.

Agents

Q/$ D

1 relevant benchmark in the decision map.

Provider price ladder

Compare all 6

Compare API pricing across 4 providers for input and output tokens, batch, and cached reads when available.

ProviderInput / 1MOutput / 1MCacheRoute
Anthropic$3.00$15.00read $0.300 / 5m $3.75 / 1h $6.00
Serverless
AWS Bedrock$3.00$15.00-
Serverless
GCP Vertex AI$3.00$15.00-
Serverless
Replicate API$3.00$15.00-
Serverless

Capabilities

VisionMultimodalReasoningFunction CallingStructured OutputsCode Execution

Benchmark peer barsfor Coding

Benchmark scores(11)

Scores are benchmark-specific and are direction-aware: the same numeric gap can mean very different outcomes across suites. Use the leaderboard context and this model's provider route to decide whether the winning margin is meaningful for your workload.
BenchmarkScoreVersionSource
HellaSwag96.210-shothttps://crfm.stanford.edu/helm/classic/latest/
HumanEval92.0pass@1https://crfm.stanford.edu/helm/classic/latest/
Massive Multitask Language Understanding88.75-shothttps://crfm.stanford.edu/helm/classic/latest/
SWE-bench Verified49.02024-10https://www.anthropic.com/news/raising-the-bar-on-swe-bench-verified-with-claude-3-5-sonnet
LiveCodeBench48.72026-04https://livecodebench.github.io/performances_generation.json
Aider Polyglot51.62026-04https://aider.chat/docs/leaderboards
BigCodeBench44.62025-01 (Instruct Pass@1)https://bigcode-bench.github.io/results.json
Chatbot Arena1340.0https://lmarena.ai
Massive Multi-discipline Multimodal Understanding68.3https://mmmu-benchmark.github.io/
MMLU PRO77.2https://huggingface.co/spaces/TIGER-Lab/MMLU-Pro
Mostly Basic Programming Problems+78.8https://evalplus.github.io/leaderboard.html

Migration checks

No linked migration route is available for this model yet.

Rankings & picks(4)

Comparison and alternatives

Browse all comparisons →
Show all 3 popular comparisonssorted by 7-day search impressions