Llama 2 70B Chat

Name: Llama 2 70B Chat
Author: AI at Meta

Released

2023-07-18

Last refreshed

2026-10-09

Status

Researched 181d ago

DeprecatedOpen weightsCommercial use: restrictedClassificationJSON / Tool use

Llama 2 70B Chat is a legacy integration reference; keep it only while you identify a current replacement.

AI at Meta releases · 11 in the last 12 monthsChangelog →

Specifications

Family: Llama 2
Released: 2023-07-18
Context: 4K
Parameters: 70B
Architecture: Decoder Only
Specialization: general
Openness: Open weights
License: Llama 2 CommunityRestricted
Weights: Available
Code: Unknown
Training: Fine-tuned

Created by

AI at Meta

Large-scale open-source AI for social technologies.

Menlo Park, California, United States

Founded 2013

Website

Pricing

Output / 1M

$0.640

Input / 1M

$0.640

Cheapest of 10 routes · DeepInfra

Providers(10)

Microsoft Foundry Alibaba Cloud PAI-EAS AWS Bedrock OCI Generative AI NVIDIA NIM DeepInfra IBM watsonx Scale AI GenAI Platform Fireworks AI Replicate API

View 10 provider routes

About

Llama 2 70B Chat is a large-scale language model with 70 billion parameters, designed for conversational AI applications. Released on July 18, 2023, it's part of Meta's Llama 2 family, featuring advanced transformer architecture optimized through supervised fine-tuning and reinforcement learning with human feedback. The model excels in generating human-like responses, outperforming many open-source alternatives and rivaling closed-source models like ChatGPT. Trained on 2 trillion tokens from diverse public sources, it's suitable for commercial and research applications in English, particularly for assistant-like functionalities. The model is available on Hugging Face for further exploration and implementation .

Providers(10)

Compare all 10

Compare API pricing across 10 tracked provider routes for input and output tokens, batch, and cached reads when available.

Provider	Input / 1M	Output / 1M	Route
DeepInfra	$0.640	$0.640	Serverless
Fireworks AI	$0.900	$0.900	Serverless
Microsoft Foundry	$1.54	$1.77	ServerlessProvisioned
IBM watsonx	$1.80	$1.80	Serverless
AWS Bedrock	$1.95	$2.56	Serverless
Replicate API	$0.650	$2.75	Serverless
Alibaba Cloud PAI-EAS	-	-	ServerlessPartial
NVIDIA NIM	-	-	ProvisionedPartial
OCI Generative AI	-	-	ServerlessPartial
Scale AI GenAI Platform	-	-	ServerlessPartial

Deprecated provider routes(4)

Provider	Status	Catalog ID
Databricks Foundation Model Serving	Deprecated	—
GCP Vertex AI	Deprecated	—
Lepton AI API	Deprecated	—
Together AI	Deprecated	—

Available via routers & gateways(16)

LiteLLM

Gateway

Open-source Python SDK and proxy server that unifies 100+ LLM APIs behind a single OpenAI-compatible interface, with load balancing, cost tracking, and configurable failover.

Free OSSGCP Vertex AIMicrosoft Foundry

OpenRouter

Hybrid

Unified hybrid gateway to 400+ models from 60+ providers via a single OpenAI-compatible API, with optional auto-routing that selects the best model per prompt.

PassthroughGCP Vertex AITogether AIFireworks AI

Portkey

Gateway

Production AI gateway routing to 1,600+ LLMs with failover, load balancing, semantic caching, and guardrails; Apache 2.0 core is fully self-hostable with the complete feature set.

SubscriptionGCP Vertex AIMicrosoft Foundry

AIRouter

Router

Commercial LLM router that analyzes incoming requests and routes to the optimal model for cost/quality/latency via a drop-in OpenAI-compatible API, with a privacy-preserving embedding mode that avoids sending prompt content.

Passthrough + feeGCP Vertex AI

Amazon Bedrock Intelligent Prompt Routing

Router

AWS Bedrock's native intelligent prompt router that routes prompts between Anthropic Claude model tiers (Haiku/Sonnet) based on predicted task complexity, with no extra per-routing charge.

PassthroughAWS Bedrock

Azure AI Foundry Model Router

Router

Microsoft Azure AI Foundry's native model router that uses a trained ML model to route each prompt in real time to the optimal Azure-hosted model, with Balanced/Cost/Quality mode selection and automatic failover.

PassthroughMicrosoft Foundry

Capabilities

Structured Outputs

Benchmark peer barsfor Classification

Massive Multitask Language UnderstandingRank 79 of 100

Gemini 3.1 Pro Preview

98.0

Clef-omni

92.7

GPT-5.5

92.4

Clef-flash

91.8

Llama 2 70B Chatcurrent

68.9

Benchmark scores(1)

Scores are benchmark-specific and are direction-aware: the same numeric gap can mean very different outcomes across suites. Use the leaderboard context and this model's provider route to decide whether the winning margin is meaningful for your workload.