Llama 2 13B Chat
Open Source
About
The Llama 2 13B Chat model is a 13 billion parameter generative text model developed by Meta, optimized for conversational applications. Released on July 18, 2023, it's part of the Llama 2 family and excels in dialogue scenarios. The model leverages supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to generate coherent and contextually relevant responses. Trained on 2 trillion tokens from diverse public sources, it outperforms many open-source chat models and matches popular closed-source models in helpfulness and safety. This model is ideal for AI engineers working on chatbots, virtual assistants, and customer service automation. For more details, visit the model's Hugging Face page [1].
Capabilities
VisionMultimodalReasoningFunction CallingTool UseStructured OutputsCode Execution
Providers(12)
Compare all →| Provider | Input (per 1M) | Output (per 1M) | Type | |
|---|---|---|---|---|
| Alibaba Cloud PAI-EAS | — | — | Serverless | |
| AWS Bedrock | $0.75 | $1 | Serverless | |
| Microsoft Foundry | $0.81 | $0.94 | ServerlessProvisioned | |
| GCP Vertex AI | — | — | Serverless | |
| Cloudflare Workers AI | — | — | Serverless | |
| DeepInfra | $0.13 | $0.13 | Serverless | |
| Lepton AI API | $0.13 | $0.13 | Serverless | |
| Together AI | $0.3 | $0.3 | Serverless | |
| Databricks Foundation Model Serving | $0.95 | $0.95 | Serverless | |
| IBM watsonx | $0.6 | $0.6 | Serverless | |
| Fireworks AI | $0.2 | $0.2 | Serverless | |
| Replicate API | $0.10 | $0.50 | Serverless |
Benchmark Scores(4)
| Benchmark | Score | Version | Source |
|---|---|---|---|
| Google-Proof Q&A | 41.8 | diamond | Open LLM Leaderboard |
| HellaSwag | 88.5 | 10-shot | Open LLM Leaderboard |
| HumanEval | 59.3 | pass@1 | Open LLM Leaderboard |
| Massive Multitask Language Understanding | 71.2 | 5-shot | Open LLM Leaderboard |
