Using Llama 3.1 70B Instruct on Databricks Foundation Model Serving
Implementation guide · Llama 3.1 · AI at Meta
Databricks Foundation Model Serving exposes Llama 3.1 70B Instruct through model ID llama3.1-70b-instruct. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.
Last refreshed 2026-07-09. Next refresh: weekly.
Quick Start
- 1
- 2Use the Databricks Foundation Model Serving SDK or REST API to call
llama3.1-70b-instruct— see the documentation for request format.
Code Examples
Pricing on Databricks Foundation Model Serving
Capabilities
About Llama 3.1 70B Instruct
The Llama 3.1 70B Instruct model is a cutting-edge large language model with 70 billion parameters, designed for instruction-following tasks. It features multilingual capabilities, supporting languages like English, German, French, and others. Fine-tuned using supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF), it excels in understanding and responding to user instructions. The model can handle a context length of up to 128k tokens, making it suitable for complex dialogue systems and applications requiring detailed responses.