Llama 2 70B Chat

Name: Llama 2 70B Chat
Author: AI at Meta

Released

2023-07-18

Last refreshed

2026-07-09

Status

Researched 136d ago

DeprecatedOpen weightsCommercial use: conditionalClassificationJSON / Tool use

Llama 2 70B Chat is a legacy integration reference; keep it only while you identify a current replacement.

Use it for

Teams maintaining an existing integration
Workloads that can use a 4k context window
Buyers comparing 4 tracked provider routes

Do not use it for

New production launches
Vision or document-understanding workloads

Specifications

Family: Llama 2
Released: 2023-07-18
Context: 4k
Parameters: 70B
Architecture: Decoder Only
Specialization: general
Openness: Open weights
License: Llama 2 CommunityCommercial use: conditional
Weights: Available
Code: Unknown
Training: Fine-tuned

Created by

AI at Meta

Large-scale open-source AI for social technologies.

Menlo Park, California, United States

Founded 2013

Website

Pricing

Output / 1M

$0.500

Input / 1M

$0.500

Cheapest of 14 routes · Lepton AI API

Providers(14)

Databricks Foundation Model Serving Microsoft Foundry GCP Vertex AI Alibaba Cloud PAI-EAS AWS Bedrock OCI Generative AI NVIDIA NIM DeepInfra Lepton AI API Together AI IBM watsonx Scale AI GenAI Platform Fireworks AI Replicate API

View 14 provider routes

About

Llama 2 70B Chat is a large-scale language model with 70 billion parameters, designed for conversational AI applications. Released on July 18, 2023, it's part of Meta's Llama 2 family, featuring advanced transformer architecture optimized through supervised fine-tuning and reinforcement learning with human feedback. The model excels in generating human-like responses, outperforming many open-source alternatives and rivaling closed-source models like ChatGPT. Trained on 2 trillion tokens from diverse public sources, it's suitable for commercial and research applications in English, particularly for assistant-like functionalities. The model is available on Hugging Face for further exploration and implementation .

Top use-case fit

Classification

1 relevant benchmark in the decision map.

JSON / Tool use

Included by capability and metadata signals in the decision map.

Provider price ladder

Compare all 14

Compare API pricing across 4 providers for input and output tokens, batch, and cached reads when available.

Provider	Input / 1M	Output / 1M	Route
Lepton AI API	$0.500	$0.500	Serverless
DeepInfra	$0.640	$0.640	Serverless
Fireworks AI	$0.900	$0.900	Serverless
Together AI	$0.900	$0.900	Serverless

Available via routers & gateways(16)

LiteLLM

Gateway

Open-source Python SDK and proxy server that unifies 100+ LLM APIs behind a single OpenAI-compatible interface, with load balancing, cost tracking, and configurable failover.

Free OSSGCP Vertex AIMicrosoft Foundry

OpenRouter

Hybrid

Unified hybrid gateway to 400+ models from 60+ providers via a single OpenAI-compatible API, with optional auto-routing that selects the best model per prompt.

PassthroughGCP Vertex AITogether AIFireworks AI

Portkey

Gateway

Production AI gateway routing to 1,600+ LLMs with failover, load balancing, semantic caching, and guardrails; Apache 2.0 core is fully self-hostable with the complete feature set.

SubscriptionGCP Vertex AIMicrosoft Foundry

AIRouter

Router

Commercial LLM router that analyzes incoming requests and routes to the optimal model for cost/quality/latency via a drop-in OpenAI-compatible API, with a privacy-preserving embedding mode that avoids sending prompt content.

Passthrough + feeGCP Vertex AI

Amazon Bedrock Intelligent Prompt Routing

Router

AWS Bedrock's native intelligent prompt router that routes prompts between Anthropic Claude model tiers (Haiku/Sonnet) based on predicted task complexity, with no extra per-routing charge.

PassthroughAWS Bedrock

Azure AI Foundry Model Router

Router

Microsoft Azure AI Foundry's native model router that uses a trained ML model to route each prompt in real time to the optimal Azure-hosted model, with Balanced/Cost/Quality mode selection and automatic failover.

PassthroughMicrosoft Foundry

Capabilities

Structured Outputs

Benchmark peer barsfor Classification

Massive Multitask Language UnderstandingRank 76 of 95

Gemini 3.1 Pro Preview

98.0

GPT-5.5

92.4

Claude Opus 4.6

91.1

DeepSeek V4 Pro

90.1

Llama 2 70B Chatcurrent

68.9

Benchmark scores(1)

Scores are benchmark-specific and are direction-aware: the same numeric gap can mean very different outcomes across suites. Use the leaderboard context and this model's provider route to decide whether the winning margin is meaningful for your workload.