Claude 3.5 Sonnet
DeprecatedAbout
Claude 3.5 Sonnet, the latest in Anthropic's line of large language models, merges state-of-the-art reasoning, coding, and natural language understanding capabilities with advanced multi-modal processing. Released in October 2024, it excels in benchmarks against previous models and competitors, thanks to its scalable attention mechanisms and massive neural network architecture. Its dynamic routing enables specialization in various tasks, supporting applications from software development and data analysis to customer support and content creation. Users benefit from its "Artifacts" feature for real-time collaborative workflows and can access the model through platforms like Claude.ai and APIs at competitive pricing rates.
Capabilities
Providers(6)
Compare all →| Provider | Input (per 1M) | Output (per 1M) | Type | |
|---|---|---|---|---|
| GCP Vertex AI | $3 | $15 | Serverless | |
| AWS Bedrock | $3 | $15 | Serverless | |
| Anthropic | $3.0 | $15.0 | Serverless | |
| OpenRouter | $6 | $30 | Serverless | |
| Microsoft Foundry | — | — | Serverless | |
| Replicate API | $3 | $15 | Serverless |
Benchmark Scores(10)
| Benchmark | Score | Version | Source |
|---|---|---|---|
| HellaSwag | 96.2 | 10-shot | HELM, official documentation |
| HumanEval | 92.0 | pass@1 | HELM, official documentation |
| Massive Multitask Language Understanding | 88.7 | 5-shot | HELM, official documentation |
| SWE-bench Verified | 49.0 | 2024-10 | Anthropic |
| LiveCodeBench | 48.7 | 2026-04 | https://livecodebench.github.io/performances_generation.json |
| Aider Polyglot | 51.6 | 2026-04 | https://aider.chat/docs/leaderboards |
| BigCodeBench | 44.6 | 2025-01 (Instruct Pass@1) | https://bigcode-bench.github.io/results.json |
| Chatbot Arena | 1340.0 | — | https://lmarena.ai |
| Massive Multi-discipline Multimodal Understanding | 68.3 | — | https://mmmu-benchmark.github.io/ |
| MMLU PRO | 77.2 | — | https://huggingface.co/spaces/TIGER-Lab/MMLU-Pro |
Rankings
Specifications
Created by
Developing safe and ethical AI systems.