LLM ReferenceLLM Reference

Llama 3.1 70B Instruct

Open Source

About

The Llama 3.1 70B Instruct model is a cutting-edge large language model with 70 billion parameters, designed for instruction-following tasks. It features multilingual capabilities, supporting languages like English, German, French, and others. Fine-tuned using supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF), it excels in understanding and responding to user instructions. The model can handle a context length of up to 128k tokens, making it suitable for complex dialogue systems and applications requiring detailed responses. It outperforms many existing open-source and proprietary models on various industry benchmarks, making it ideal for conversational AI, content generation, and data synthesis tasks. For more details, visit the Hugging Face page [1].

Capabilities

VisionMultimodalReasoningFunction CallingTool UseStructured OutputsCode Execution

Providers(11)

Compare all →
ProviderInput (per 1M)Output (per 1M)Type
OctoAI API$0.9$0.9Serverless
Together AI$0.88$0.88Serverless
Fireworks AI$0.9$0.9Serverless
NVIDIA NIMProvisioned
Microsoft Foundry$2.68$3.54Provisioned
Databricks Foundation Model ServingProvisioned
Hyperbolic AI Inference$0.40$0.40Serverless
DeepInfra$40$40Serverless
OpenRouter$0.4$0.4Serverless
IBM watsonx$0.8$2.4Serverless
AWS BedrockServerless

Benchmark Scores(3)

BenchmarkScoreVersionSource
HellaSwag94.210-shotOpen LLM Leaderboard
HumanEval84.1pass@1Open LLM Leaderboard
Massive Multitask Language Understanding86.05-shotOpen LLM Leaderboard

Rankings

Specifications

FamilyLlama 3.1
Released2024-07-23
Parameters70B
Context128K
ArchitectureDecoder Only
Specializationgeneral
Trainingfinetuning

Created by

Large-scale open-source AI for social technologies.

Menlo Park, California, United States
Founded 2013
Website