LLM ReferenceLLM Reference
Microsoft Foundry

Llama 3.1 405B Instruct on Microsoft Foundry

Llama 3.1 · AI at Meta

ProvisionedOpen Source

Compare Llama 3.1 405B Instruct Across Providers

ProviderInput (per 1M)Output (per 1M)
OctoAI API$3.00$9.00
Together AI$5.00$15.00
Fireworks AI$3.00$3.00
IBM watsonx$3.00$9.00
Scale AI GenAI Platform
View all 10 providers →

Pricing

TypePrice (per 1M)
Input tokens$5.33
Output tokens$16.00

Capabilities

VisionMultimodalReasoningFunction CallingTool UseStructured OutputsCode Execution

About Llama 3.1 405B Instruct

Llama 3.1 405B Instruct is Meta's advanced large language model released on July 23, 2024, featuring 405 billion parameters. It utilizes an optimized transformer architecture with supervised fine-tuning and reinforcement learning for enhanced instruction-following capabilities. The model supports multiple languages, was trained on 15 trillion tokens, and fine-tuned with 25 million synthetic examples. It excels in multilingual dialogue and text generation, making it ideal for assistant-like applications. Llama 3.1 incorporates robust safety measures and ethical considerations, outperforming many existing models on various industry benchmarks. AI engineers can access the model via its Hugging Face page for implementation in diverse NLP tasks.

Get Started