LLM Reference
Microsoft Foundry

Using Llama 3.1 70B Instruct on Microsoft Foundry

Implementation guide · Llama 3.1 · AI at Meta

ProvisionedOpen Weights

Microsoft Foundry exposes Llama 3.1 70B Instruct through model ID llama3.1-70b-instruct. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-07-09. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at Microsoft Foundry and generate an API key.
  2. 2
    Use the Microsoft Foundry SDK or REST API to call llama3.1-70b-instruct — see the documentation for request format.
  3. 3
    You'll be billed $2.68/1M input, $3.54/1M output tokens. See full pricing.

Code Examples

See Microsoft Foundry documentation for integration details.

Pricing on Microsoft Foundry

TypePrice (per 1M)
Input tokens$2.68
Output tokens$3.54

Capabilities

Structured Outputs

About Llama 3.1 70B Instruct

The Llama 3.1 70B Instruct model is a cutting-edge large language model with 70 billion parameters, designed for instruction-following tasks. It features multilingual capabilities, supporting languages like English, German, French, and others. Fine-tuned using supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF), it excels in understanding and responding to user instructions. The model can handle a context length of up to 128k tokens, making it suitable for complex dialogue systems and applications requiring detailed responses.

Model Specs

Released2024-07-23
Parameters70B
Context128k
ArchitectureDecoder Only
Knowledge cutoff2023-12

Provider

Microsoft Foundry
Microsoft Foundry

Microsoft

Redmond, Washington, United States