LLM ReferenceLLM Reference

Llama 2 7B

Open Source

About

The Llama 2 7B model is a powerful generative text model developed by Meta, featuring 7 billion parameters and utilizing an optimized transformer architecture. Trained on 2 trillion tokens from diverse public sources, it excels in various NLP tasks, particularly dialogue applications. The model has been fine-tuned for helpfulness and safety using supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF). It outperforms many open-source chat models and competes with popular closed-source alternatives. AI engineers can easily integrate this model into their projects for advanced natural language understanding and generation capabilities through Hugging Face .

Capabilities

VisionMultimodalReasoningFunction CallingTool UseStructured OutputsCode Execution

Providers(1)

ProviderInput (per 1M)Output (per 1M)Type
Fireworks AI$0.2$0.2Serverless

Benchmark Scores(4)

BenchmarkScoreVersionSource
Google-Proof Q&A35.9diamondresearch
HellaSwag85.110-shotresearch
HumanEval45.1pass@1research
Massive Multitask Language Understanding63.55-shotresearch

Rankings

Specifications

FamilyLlama 2
Released2023-07-18
Parameters7B
Context4K
ArchitectureDecoder Only
Specializationgeneral
Trainingfinetuning

Created by

Large-scale open-source AI for social technologies.

Menlo Park, California, United States
Founded 2013
Website

Providers(1)